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ABSTRACT 



REVIEW OF STATE VR AGENCY PROCEDURES FOR CASE FLAGGING: A QUALITY ASSUR-- 
ANCE ACTIVITY, by Susan Stoddard, Ph.D., J, Mark Rogers, Shirley Langlois, 
Caleb IVhittaker, and Deborah Kogan, Berkeley Planning Associates, April 
1983, 51 pp., with separately bound appendix. 

This report reviews the practices implemented by 53 different state 
VR agencies to address quality assurance concerns . After reviewing the 
broader spectrum of monitoring practices and evaluation systems used by 
different state agencies to assess worker and agency performance, the 
report focuses on the range of procedures utilized to track timeliness , 
which has been adopted as one of the procedural standards of service 
quality in the revised Standards Evaluation System. The report also reviews 
actual findings on the extent of timely versus untimely service in four 
Model Evaluation Unit (MEU) states, based on data from a small client 
sample in each state. 

The materials included in the Appendix demonstrate the variety of 
methods employed by states to control for quality and timeliness in their 
respective case management systems. The names of state agencies that 
responded to our request to send materials are listed in the table of 
contents of the next page. The table of contents also lists the code 
letter and number used to identify the corresponding state agency's 
materials in the Appendix. 
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APPENDIX: 


TABLE OF CONTENTS 




DLate Agency 


Code Labeling 
State Agency 

\ iff _ ^ A ^ T 

Materials 


State Agency 


Code Labeling 
State Agency 
Materials 


Alabama 


A-1 


New York 


N-5 


Alaska 


A-2 


New York - Blind 


N-6 


Arizona 


A- 3 


North Carolina 


N-7 


Arkansas 


A- 4 


North Carolina - 


Blind N-8 


California 


C-1 


North Dakota 


N-9 


Connecticut 


C-2 


Ohio 


0-1 


Delaware 


D-1 


Oklahoma 


0-2 


Florida 


F-1 


Oregon 


0-3 


Florida - Blind 


F-2 


Pennsylvania 


P-1 


Idaho 


I-l 


Pennsylvania - Blind P-2 


Illinois 


1-2 


Puerto Rico 


P-3 


Indiana 


1-3 


Rhode Island 


R-1 


Iowa 


1-4 


South Carolina 


S-1 


Kansas - Blind 


K-1 


South Dakota 


S-2 


Kentucky- 


K-2 


Tennessee 


T-1 


Kentucky - Blind 


K-3 


Texas 


T-2 


Louisiana 


L-1 


Texas - Blind 


T-3 


Maine 


M-1 


Utah 


U-1 


Maryland 


M-2 


Vermont 


V-1 


Massachusetts 


M-3 


Virginia 


V-2 


Michigan 


M-4 


Washington 


W-1 


Michigan - Blind 


M-5 


West Virginia 


W-2 


Minnesota 


M-6 


Wyoming 


W-3 


Montana 


M-7 






Nevada 


N-1 






New Hampshire 


N-2 






New Jersey 


N-3 






New Jersey - Blind 


N-4 







CASE RECORD KEVHJiJ INSTRUMENT * 




Client: 

District : 
Reviewer : 
Date: 



I. ELIGIBILiry 



A. 


Date of Application: 






B. 


General medical adequate? (diagnosis + prognosis) 


YES 


NO 


C. 


Specialist examination adequate? (diagnosis + prognosis) 


YES 


NO 


D. 


Disability clearly established? 


YES 


NO 


E. 


Disability: 






F. 


Counselor rationale clearly describe vocational handicap (s) 


YES 


NO 


G. 


Reasonable expectation clearly established by counselor? 


YES 


NO 


H. 


Client eligible? 


■ YES 


NO 


I. 


Date eligibility established: 







II. WVm VUALLV imUEN REHABILITATIOW PROGRAM 



A. 


Vocational goal: 






B. 


Case record information clearly justify vocational goal? 


YES 


NO 


C. 


Intermediate objectives clearly stated? 


YES 


NO 


D. 


£ach intermediate objective* rslate to obtainment of 








vocational goal? 


YES 


NO 


E. 


Services planned reflective of client *s docufnentcd ' 








rehabilitation needs? 


YES 


NO 


F. 


Evidence that Similar Benefits iiivestigated? , 


YES 


NO 


G. 


Evidence that Similar Benefits identified? 


YES 


NO 


H. 


Evidence that Similar Benefits used? 


YES 


NO 


I. 


Each intermediate objective include evaluation criteria? 


YES 


NO 


J. 


Each intermediate objective include 'time frames? 


YES 


NO 


K. 


Does II^RP meet minimum standards? 


YES 


NO 



N/A 



III. PLACEMEm-fCLOSUnE 



A. 


Evidence that counselor directly assisted client in 






B. 


placement? 


YES 


NO 


Placement/closure consistent with IWRP vocational goal? 


YES 


NO 


C. 


Occupation: 




D. 


Case followed for 60 consecutive days in employment? 


YES 


NO 


E. 


Evidence client advised of availability of Post Employment 






F. 


Services? 


YES 


NO 


Evidence client notified that case was being closed? 


YES ' 


NO 


G. 


Date of closure: 






REMARKS: 










PLAN OF ACTION 
QUARTERLY REVIEW REPORT 

DATE: " . AREA QTR 

I 
I 

TO: .ASSIGNMENT ' 

FROM: 





02 


10 




TOTAL 


26 Closures 
SO 


SGA 
SSI 


SGA 
SSDI 


GOALS 














ATTAINED 




% 




% 




% 




% 




0/ 




% 



TOTAL ACTIVE CUMULATIVE 



01 CASE SERVICE ALLOTMENT 

01 CASE SERVICE ENCUMBRANCES ' EXPENDITURES 

TRAVEL : 

PROJECTED 

USED 

REMARKS : (eligibility documentation, IWRP development, placement, production, 
CPR's timely, etc.) ' ^ . 



PLAii OF ACTION (corrective) 



A-± 



COU.'iSELOi^'S SIGmATUP.E 

7 



CtlUNTY A',7 



V u C A T 1 G f( A L i' K h A L i L J 

0^/06/111 
CASELCAD INVENTCRY 
FY 81 



COUKSL=LGP. 001 AREA 



CASE 

■"52793 0 
" 51329<J 

,. 544653 
544 578 
_527877 
544 580 
'52 7943 
544579 
■ 526507' 
527950 
•513237 
_527959' 
513220 
527 95 3 
75"! 3 42 2 
5278J0 
_527748 
_52 795'a" 
527753 
527957 
" 4d9'7l6' 
527897 
_.p2 789 8_ 
~ ii-V4:504 ' 
5 '7 4 56 6 
51335V 
"5.1.3'3ob"' 
51?t?jS7 
527870 
.51341.3" 
^5 2 7 64 6 

~4 '0992 0 
527636 
527805 

~52794'5'^' 

.409 76 8 '^^ 
"'54465'5' 
475280 
513 224_ 
"409630 

j2.774'l__ 

409651 
•409923 
.'5279"6i"' 

409943 
.527929 

513386" 



NAME 




CURRENT STATUS 



'02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02 

02' 

02 

02 

02 

02 

02 



02 



. B. 

HG 
J 

KO 
AR 
KH 
AD 



06 
06 
06 
06 

10 
'10 
10 
10 
10 

12 



16 
16 
16 
16 
16 
16 



DATE OF 
LAST ACTICN 



10/03/80 



03/16/81 



02/10/81 



OATE 
REFERRED 

1/05/61 
1/14/ SO 
1/05/61 
2/24/81 
3/18/61 
. lO/Ot/SO 
3/10/81 
3/02/81 
3/09/ 81 
3/13/79 

12/15/80 
3/03/80 

12/09/80 

' 4/2I/S0 

l2/0c?/80 
6/05/80 
9/02/80 
9/06/80 

12/09/80 ■ 
9/03/80 

12/08/80 
7/09/79 
9/26/SO 
9/ 15/ 80 

' 3/02/81" 
3/30/81 
4/21/80 
5/12/30 
5/13/80 

io/15/ao 

6/03/80 
7/14/80" 



07/21/80 


12/03/79 


12/05/80 


7/30/80 


01/27/81 


10/20/80 


03/23/81 


1/01/ 81 




8/13/79 


03/20/81 


2/12/81 


05/01/80 


10/05/77 


03/ 13/31 


4/22/80 


09/23/60 


9/17/79 


03/11/Gi 


9/15/83 


07/01/80 


10/01/79 


10/20/30 


12/03/79 


01/05/31 


9/23/80 


09/23/80 


12/10/79 


03/05/81 


2/02/31 


OS/01/60 


5/i3/80 



r7^ 





»I-:PART.\IE!\'T0F educatioi^ 

DimiOM Of VOCA TIOMAL REHABIUTA T10J» I 

Michael C. Morgan, Director / 

t 

April 22, 1981 



I 



JAY S. HAMMOftD. GO 

Central Office 
Pouch F, M,S.0581 
State Office Building 
Juneau, Alaska 99811 
(907) 586-6500 



\miMOR 



Ms. Susan Stoddard 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, CA 94703 

Dear Ms. Stoddard: 

In your letter to Mike Morgan, dated April 1, 1981, you requested infor- 
mation concerning our case flagging and case review procedures. Accordingly, 
I can offer the following. With respect to case flagging, this agency 
has maximum time periods that a client can remain in certain statuses 
where experience has shown clients can become "lost" without prop'^r 
monitoring. The statuses and flagging levels are given below 



STATUS 


FLAGGING 


00 


60 days 


02 


60 days 


06 


480 days 


10 


90 days 


20 


60 days 


22 


120 days 


24 


60 days 



alert counselor of 18 month 
legal limit) 



With regard to quality assurance, this is addressed via case reviews 
using the San Diego State case review scheduled. Case reviews wit i this 
instrument are accomplished periodically by district supervisors, and at 
least once a year by the agency's case review team. This review team 
accomplishes the overall casework qual ity control and evaluation function 
tor the agency. It is composed of the Deputy Director, the Fiscal 
Officer, the Chief and Assistant Chief of Rehabilitation Services, and a 
district supervisor not having responsibility for the office being 
reviewed. Offices are normally reviewed on a one year cycle. If signi- 
ficant problems are found these are pointed out, and the team returns in 
six months to insure that corrective action has in fact been taken. 
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vRM9o.a(3.aoi ARIZONA DEPARTMENT OF ECONOMIC SECURITY 
CASE REVIEW SCHEDULE -CLOSURES 



CLIENT NAME 


CLIENT NO. 


Yes 


r.'o 


N/A 


Rclcrcnccj 


Rc'Rqview 


VR Manual 


Yes 1 No 


IL All QOSXITO 














A. 08 Qosures 














1. Closure form is signed znd includes appropriate justification 








2.08.B; 2'(^b(VR'002B) 






2. Sufficient efforts were made to contact client 


> 






2-OS.B 






3. Qient notified in writing of closure decision including 
rationale, available recourse, annual review, etc. 








2«08.B 






4. Qient was referred to other services when appropriate 
and other services are necessary and available 








2-08.B 






5. Copy of SSA-853 in case file for all SSI/SSDI beneficiaries 








8-01; 6-02 






6. Referral source notified 








2-01.C.5 






7. Coses closed as too severely disabled were reviewed by consultant 








2-02.F.3.g 






8. Client address updated on CSR at time of closure 














B. 26 Qosures 














1. Qient has accomplished the intent of services as described 
in client's rehabilitation plan (if not, this is noted and explained 
on certification of closure) 








2-08.C.l.a 






2. Qient notified of closure decision 














3. Qosure includes references to need for post-employment service 








2-05 (VR'002F) 






4. Documentation that client has been employed 
for a minimum of 60 days 








^*UO.w. X.L.I 






5. Substantial services rendered 








2-08.C.b 






6. Placement is suitable {e.g,^ type, pay, etc) 








2-08.C.C 






7. Disposal of equipment discussed in progress notes 








3-02.E.3 






8. ^Jopy of SSA-853 in case file for all SSI/SSDI beneficiaries 








6-01; 6-02 






9. Provisions made for annual review of 
clients placed in sheltered employment 








2-05,B.ll.d 






10. Services checked on Certificate of Qosure 
agree with IWRP-Prog. of Services 














11. Qient address updated on. CSR at time of closure 














w. Vi^uoi^u iiOb rvenaDUiuitcu {oianiscs C£ ^uj 














1. Qient notified in writing of closure decision 














2. Ineligibility decision is explained and includes reference to the 
availability of annual review, appeal process 








2-08.D 






3. All purchased equipment has been recovered 








3-02.E.3 






f 4. Copy of SSA-853 m file for all SSI/SSDI beneficiaries 








6-01; 6-02 






5. Consultation was effected for client closed as foosfii;ere/y d£sa6/ed 








2.02.F.3.g 






6. Services checked on Certificate of Qosure 

agree with IWRP-Prog. of Services ✓ 

DISCUSS ITEMS MARKEO **NO- AND QU A 1-IT ATI V C ASPECTS c-A.<;ir 
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VR.1S0.A ti-Mj ARIZONA DEPARTMENT OP ECONOMIC SECURITY 

CASE REVIEW SCHEDULE - STATUSES 05, 12-24 & 32 



UCCNTNAMb ' irUlJK.T nA. 


Yes 


No 


N/A 


References 
1 VR ManiuJ 


Re-Revicw 
v.. 1 


D. r\VRP f(/]esc review items are applied to all IWRP's in file) 














1. IWKP Program of Services is dated and shows 
all required dales and signatures 








2»07 C n a» o.fi'^ A fi» 
2-05.B.9;2-08.C.l.d.iv 






2. Vocational objective is seated 

(not required for an IWRP for Extended Eval alone) 








2.05.B.7.C 






3. Program of Services is complete (contains all services necessary 
to achieve vocational goal, whether sponsored by VR or not) 








2-05.B.7.d.i 






4. Type and name of training specified 








2-05.B.7.d 






5. Projected ending dates (for intermediate goals) 
with anticipated outcomes are specified 








2-05.B.7.d 






6. Performance criteria (specific to individual services 
being provided) are specified 








2-05.B.7.d 






7. Similar Benefit Review (VR-OOIA) is completed 








fVR.on 7-11 






8. Use of all available similar benefits 
is documented on Program of Services 








3-03.B 






9. Amount of client's financial participation is specified. (Applies onN 
when there is no economic need and services other than training 
and counseling were provided^ ) 








3'03.A 






10» Ail aiiiendments are recorded on IWRP 








2-02.F.3.C 






ii. neviews or progress accomplished (IWRP) at least annually 








2-05.3.8.0 




















i. c^ervice rroviaer U)ncracts m iile and signed. (For restoration services 
there must be a new contract for each 3*month segment.) 








3-02.D 






2. If special funds were used 














a. Referral forms in file 








6-01; 6-02.C.1 






b. Verification in file 








6-01; 6.02.C.1 


1 


c. Assignment sheet completed and in file 










1 


3. If equipment was purchased, file contains bid quotations for 
purchases over $500, and equipment contracts (VR-OIS) 
tot purchases over $100. 








3-02.E 






4. If client is/was on Status 06, services stayed within 18-month limitation 














5. If services are being provided in Status 14, 
there are counseling notes in file 








2-07.B 






6. If restoration services are provided, continuing medicai*psychologicai 
consultation accomplished on VR.004A (a minimum of every 
3 months for ongoing restoration) 














7, In-senrice statuses used appropriately (06, 14, 26, 18, 20, 2Z 24) 








Manual 






8. All purchases for services were made in accordance with IWRP or 
IWRP amendments. (If *^V0" check either a, b, or c, below) 








3-02.0 






a. Discrepancies between totals on IWRP and Client Case Cost 
Record more than S200 but less than S750 




1 




2-05.B.7.d 






b. Discrepancies between totals on IWRP and Qient Case Cost 
Record more than $750 but less than $1,500 














c. Discr3pancies between totals on IWRP and Qient Case Cost 
Record over $1,500 














9. Oient Income Statement is completed and signed (hot required if 
only counseling or training is provided) 








0 /\ri^ nn/^\ 






10. If basic or relocation maintenance was provided, the maintenance 
worksheet (VR-006) is completed and adequr^ie 








2-07.E 






11. Justification for travel and supplemental maintenance is provided 
and adequate (explain the need and rationale for $ amount) 








2-07.E 






12. PES were pro\ided in accordance with policies 








2-07.K 








vi«-i9o(j-ao| ARIZONA DEPARTMENT OF ECONOMIC SECURITY 

CASE REVIEW SCHEDULE ^ 



c 



GHENT NAME 


CLJENT NO. 


CASE STATUS 


DISTRICT NO. 


DATE OF REVIEW 


REVIEWER 


RE*ReVlEW DATE 


Dates on Forms 


CSR Daces 
- 


N/A 


CSR & Form 
Dates Agree 


L Hmeliness of Services — Case Movement * 


Yes 


No 


1. Referral received in office (Status 00) 












2. Application signed (Status 02) 












3. Client certified for extended evaluation (Status 06) 












4. Cose closed in jtatiis 08 












5. Qient certified for regular services (Status 10) 
























7 (TflcA ringed in ^tatu^ 50 












R Pri^gt '-in^ nT c<>rvicp< iniHstiPrl /^fnHtc^^ 1A 1 fi 1 Si\ 
o* AiU^iaJU u& ;><;lyiuc9 iiiii>iabcu (Otuiuoco x4rf JO C^r iO/ 












^» inai pnj^iiuu UL V iv.ca ^uiii|jictcu 1 1/70* oiaius ^v/ 












oiiciib Oc^oii cLU(jiuj uieiiv |x inui OidillS ^mil 












11. Case closed as rehabilitated (Status 26) 








1 


12. Case closed in Status 28 








1 


IL Content Review 


Yes 


No 


N/A 


Rclcrcnces 


Re-Rcview 


VR Manual 


Yes 


No 


A. Initialinterview and application. 














1. Initial interview notes include: 














a. Identifying information 








2-01.E.4 






b. A statement of problems in terms of reason for referral to agency 








2.01.£.4 






c. Information including personal and social data, medical and/or 
disabling aspects, educational and vocational background 








2.01.E.4 






d. Qient expectations 








2.01.E.4 






e. Action steps 








2-01.E.4 







For clients in OZ, stop here. If closed in 08 from 02, complete section IV-A. 



B. Med/Psych/Voc Study 














1. Pre-Certifjcation Medical Review accomplished 








2-04 (VR'004) 






2. Record of a complete physical examinadon, no older than 
three months prior to application 








2-02.C.1 






3. All specialist exams required by regulations were acquired 








2-02.C and D 






4. Disabilities coded are consistent with reports 
and RSA coding structure 








CSR Manual 






5. Severe disability properly coded and explained when necessary 








3-07 Attachment A 






6. Necessary and appropriate consultation accomplished prior to 
acquiring specialist exams other than thosa required (See B. 3.) 








2-02.F 






C. Certification 














1. Certification is signed and dated 








2-04 (VR^04) 






2. Explanation for use of e.xtended evaluation provided on 
VR.004 and adequate 








2.04.A.4 






3. Explanation for certification of eligibility 

provided on VR»004 and adequate 








2-04.A.3.b 






4. The substantial employment handicap fS-EH^ is 
adequately explained on VR.004 








2-04.A.3.a 







DISCUSS ITEMS MARKED NO, AND QUALITATIVE ASPECTS OF CASE 



_ . 

For clients in Status 10, step hen. Clients closed in Status 30, skip to section FV-C. 
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Arkansas Department of Human Services 

Division of Rehabilitation Services 



_ , ,„, . ^ 1401 Brookwood Drive 

Frank White P.O. Box 3781 

Little Rock. Arkansas 72203 

Ray Scott 37i-24ii 

Executive Doecior 



April 17, 1981 



Susan Stoddard 

Project Director ' * 

Berkeley Plannins Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Susan: 

In regard to your inquiry of April 1, 1981, about case 
flagging procedures, I find that we have no highly struc- 
tured formalized process for case flagging other than that 
contained in the San Diego Case Review System. However, 
our program administrators and first line supervisors 
may employ informal processes at their discretion. 

Our agency uses the San Diego System as the basic quality 
control instrument for our internal case reviews and 
audit procedures. 

Thank you for your interest. 



Very truly yours. 




E. Twussell Baxter, Commissioner 
/dgp 



ERLC 



The Arkansas Deparlmeni of Human Services is in compliance with TiUes VI and VII o( the Civil Rights Act and is operated, managed and delivers 
"services without regard to age, religion, handicap, sex, race, color or national origin." 




■STATE OF CAIIFORNIA-HEAITH AND WELFARE AGENCY EDMUN D G. BROWN JR., Oovttnot 

DEPARTMENT OF REHABILITATION ~ 

830 "K" STREET MAIL 
SACRAMENTO, CALIFORNIA 95814 

(916) 322-0723 

April 15, 1981 



Ms. Susan Stoddard 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, CA 94703 '. . 

Dear Ms. Stoddard: 

In reply to your letter of April 1, 1981, I am enclosing information 
on the California Department of Rehabilitation's Quality Evaluation 
Forms CQEF) and flagging of cases in plan statuses. For over a year, 
the Department has used the QEF to evaluate the quality of each case 
attaining an open status of 06 (extended evaluation) or above. A copy 
of the current and proposed new QEF is attached. The QEF method 
IS used not only as a supervisory aid, but also for evaluation purposes 
at the case-carrier and district levels. 

Flagging of cases to identify where there might be undue delays is 
not done m California. Instead, each case reaching in-plan status 
(14, IG, or 18) is required to be reviewed every twelve months by 
a supervisor. The flag is printed' in the "PLAN REVIEW" column of the 
counselor's Caseload Activity Listing. A "YES" means the case should 
be reviewed by the counselor and supervisor. Three months before the 
estimated date of plan completion, the completion date is printed 
in the appropriate "COMPL DATE" column. This second flag remains 
until either the planis completed or there is a major plan revision 
A sample page from the Caseload Activity Listin g is attached showing 
the use of both columns. 

Recently, the Department has taken action to review all cases with 
overdue plan completion dates. Computer lists of all cases with 
overdue completion dates have been sent to the counselors. Through 
this process the number of cases with overdue plan completion dates 
has declined by nearly 50 percent. 

Please keep the Department informed as to your project's progress. 

If I can be of any further assistance, please call me at (916)322-0723. 

Sincerely, 




?akao Iwasa, Assistant Chief 
Program Evaluation and Statistics Section 

TI:ch 

Attachments 

cc; Thomas E. Rietz 

Paul F. C. Mueller 

O 



I. 



INSTRUCTIONS FOR COMPLETING QEr 



EmployoG Status 

Probationary employoo: Complete QEF on all cases. 

Pennanent employee: For those employees whose last evaluation 

was rated below standard, complete QEF on 
all cases. 

For those employees whose last evaluation 
was rated standard or above, complete QEF 
when case being rated 1s rated as "exceeds 
standard*' or "improvement needed". 



When Each Section Should Be Completed 

Section I when client is placed into new extended evaluation plan. 

Section II If Status 00 closure from 06 or at plan approval. 

Section III at plan approval. 

Section IV at time of Status 26 or 20 closure. 



How To Complete Form 

1. Complete identifyinc) Information. 

2. Check appropriate box for each section as "exceeds standard", 
"standard", or "improvement needed". If section is rated as 
"exceeds standard" or "improvement needed" check appropriate 
reason(s) listed below. Reasons checked should be consistent 
with overall ratincj. 

3. Use the con^nont space if "reason" is other then listed. 
4! Comment if necessary or appropriate. 

5. Initial and date only sections completed. 



Dcf ini tions 

Exceeds Standard: Definitely exceeds standard expectations 

in specific, identifiable areas. 

Standard: Average or fully meets expectations. 

Improvement Needed: Definitely below standard expectations in 

specific, identifiable areas. 



DR Form 239 (1-00) tOUALITY EVALUATION FOR^l 

DistVict Code: ' Client's Nninc: 

Counselor Nnmo/Codo: Client's SS//: 



I. APPROPRIATE EXTENDED EVALUATION PLAN 

□ EXCEEDS STANDARD* [J STANDARD Q IMPROVEMENT NEEDED* 

□ Timely decisions and services delivered from referral to extended evftluntion 

□ Evidence timt eligibility determination cannot be made without extended evaliintioh. 

□ Extended evaluation plan will be sufficient to determine eligibility. 

COMMENTS: 



PS Initials: Date: 



II. APPROPRIATE ELIGIBILITY DETERMINATION 

□ EXCEEDS STANDARD* Q STANDARD Q IMPROVEMENT NEEDED* 

n Timely decisions and services delivered from referral to acceptance/closure (08-06). 

□ Adequate case recording describes client's situation from ref. to acceptance or Oa/6c 

□ Appropriate examinations (e.<)., medical evaluations and consultation obtained) 
n Accurate and realistic interpretation of diagnostic data. 

□ Appropriate eligibility decision demonstrated through le(ial documentation (e.ii.» 

statement of eligibility, medical and specialty exams/psych. tests). 

COMMENTS: 



PS Initials: Date: 



II. APPROPRIATE REHABILITATION PLANNING 

□ EXCEEDS STANDARD* □STANDARD □ IMPROVEMENT NEEDED* 

□ Appropriate data obtained to develop client's plan. 

□ Accurate and realistic interpretation of data (medical, social, psych economic) 

□ Cooperation and involvement of client secured. 

□ Appropriate vocational objective selected. 

□ Sufficient plan services provided for in IWRP. 

□ Similar benefits considered and provided where appropriate. 
COMMENTS: 



PS Initails: Date: 



IV. SUFFICIENT SERVICES 

□ EXCEEDS STANDARD* □ STANDARD □ IMPROVEMENT NEEDED* 

□ Timely decisions and services delivered from plan to closure. 

□ Adequate case recording to describe client's pro(iross from plan to clo'-.ure, 

□ Sufficient services provided or arragned during plan. 

n Records demonstrate that- client received placement assistance. 

□ Closure appropriate considering the client's level of achievement. 

COMMENTS: 



PS Initails: Date: 



APPROPRIATE RF:A^^*<(S) H' CASE RATED A5 EXCEEDS St/\f{DARD OR IMPIinvrMFNT NFED'^O 



QKi" i)i;ri/iiTioNs 

'f- Appropri.uc lixtfiulcd liv.ilu.Ulon I'lnn 



^^^:cir.ion to 



"11,0 client's rdubillUlion pololiuVl. "'""9 ' l"-"cnlcil ILclinc. u, il,.,- 

II. Ap|,ro|„M,u, CHjHim, OHcr.lnalon 

- "»« ii-u>' or Jii,Jn;?;i"„,',i.;,;;;3 iI;cT,",'4;;:,',5'-"- 

., .«,„.,r-„,u„ to jolcrlto ri';o;,;'r;Vi„o;is;;,;,;;,";;,,',;;„'i'f "■■-f'?K.rfhT„or 
jif sSiffiiSf^ff^i^i^sf^ »o„oi,.e;.^;„, .„„ „„. 

^^i^wmm-^s^\im^;,£s^ ..o,»,.. „„„ 

III. Appropriate I«;hab1 1 UaUon Pl,innln.| 

cl..Mf;. JnlnvuhT^NdTifBr^^^^ 'S*^'^' ""'^f--tn.t will, the 

Ofpartent's rusourcir:; . nmiiatlons. ond economic circimir.t.uicc.s ar. wi.]] ai tlio 

a'B-?iTr«r;!!'t|^^^^^^^^^ .o,-,.co.. :.„o„ tr„„„„„ 

I'lolio,, of. lullli. •"'II'O' I'od .ml i.rovldo.l 10 U<-.«n T.ma-:.sM i,,,. 

o>od ,u . client .l..ri\,9:,,l\^n'\.;:!;:,,J;t';£»',,;;-JJ,l»j; 1^^ consldon,., 

IV. Sufficient Services 
Ado.iu.Ui. Cr.t. niH-onllnn »n n .• u r, • --i-M vu.ef. delivered withoul dchiy. 

ar;S?|-ISS?vSv-r^^^^^^^ ciiont.. „.,.,i., ,„ ,„„ 

Koco,*. Oo.,on,t,-,uc ,l,.u Cll,.„t It , """ -l'l'™l"l«'o. 

^ ^^;'Votn..v-c..rS'"i;-H?S^ c,o.,.. „o,.o 

FRIC ' 

J / 



DR 239A 

D1.Gtr.ict Code: 

Counselor Name/Code: 
PS Initials: 



QUALm EVALUATION SUMMARY FORM 

A B . C 



Element 


Number of 


Value of 


Value of 
Cases Rater 


I. APPROPRIATE EXTENDED EVALUATION PLAN 

1. Number of new extended evaluation plans .... 

2. Number of cases rated Exceeds Standard 

3. Number of cases rated Improvement Needed .... 

4. Number of cases rated Standard (Al - A2 & A3) . 

5. Sum of values (C2 + C3 + C4) 

6. Aver rating for appro ext eval plan (C5 4 Al) . 






■Li'i'.'tVi'L'/.'i'.'.Vl^.'.sv.; 




X 3 

X 1 

X 2 
















1 


II. APPROPRIATE ELIGIBILITY DETERMINATION 

1. Number of cases rated 08 from 06 plus new plans. 

2. Number of cases rated Exceeds Standard 

3. Number of cases rated Improvement Needed .... 

4. Number of cases rated Standard (Al - A2 S A3) . 

5. Sum of values (C2 + C3 + C4) 

6. Averaqe rating for appro eligibility (C5 i Al) . 










X 3 
X 1 
X 2 


















III. APPROPRIATE REHABILITATION PLANNING 

1. Number of new plan cases rated 

2. Number of cases rated Exceeds Standard 

3. Number of cases rated Improvement Needed .... 

4. Number of cases rated Standard (Al - A2 & A3) . 

5. Sum of values (C2 + C3 + C4) 

6. Averaqe ratinq for rehab planninq (C5 4 Al) . . 


★ 


X 3 
X 1 
X 2 






















IV. SUFFICIENT SERVICES 

1. Number of 28 + 26 cases rated . 

2. Number of cases rated Exceeds Standard 

3. Number of cases rated Improvement Needed .... 

4. Number of cases rated Standard (Al - A2 & A3) . 

5. Sum of values (C2 + C3 i C4) 

6. Aver rating for sufficient services (C5 4 Al) . 










X 3 
X 1 
X 2 
















-it 




★ 


V. OVERALL RATING 

1. Total number of cases rated 

2. Total value of cases rated (sum of values)* . . 

3. Overall ratinq (A2 4 Al) 









CALIFORNIA STATE DEPARTMENT OF REHABILITATION 

Time Period of Cases Reviewed: 

. From: ^ To: _^ 

Date of Review: 



3.00 - 2.16 Exceeds Standard; 2.15 - 1.05 Standard 



1.84 - 1. 



00 Improvement Needed 



CALIFORNIA STATE DEPARTfCNT OF REHAB ILITATION 
PROGRAM EVALUATION AND STATISTICS SECTION 
DISTRICT EVALUATION QUALITY EVALUATION FORM 



District Code: 
Caseload Code: 
Rater's Name: 



Client's Name: 
Client's SS#: 
Case Status : 



ES S IN 
□ □ □ 



I. - APPROPRIATE EXTENDED EVALUATION PLAN * 

a. Timely decisions and services delivered from referral to extended 
evaluation. 

b. Evidence that eligibility determination cannot be made without 
extended evaluation. 

c. Extended evaluation plan is sufficient to determine olig..- ity. 



COMMENTS : 



ES S IN 

□ □ □ 11- APPROPRIATE ELIGIBILITY DETERMINATION 

Timely decisions and services delivered from referral to acceptance (10) 

or closure (03-05) . 

b. Appropriate examinations and consultation obtained. 

c. Accurate and realiistic interpretation of diagnostic data. 

d. Legal documentation complete.* 

G. Adequate information in case to certify el igibil ity. 



COMMENTS: 



*If all appropriate check-off boxes, and counselor or P.S. signature blocks are not 
complete, do not d?^op the level of the overall item rating, but document every 
instance v;here this occured under the comments section (DR 229A, DR 229AA, DR 229B, 
Medical Jacket). 



^Poviscd 2/31 

ERIC 



KEY: ES - Exceeds Standard 
S - Standard 
IN - Improvement Needed 



□ [J ■ tJ III. /WIfMUATr JKIjA * 

— .n. AppropricUt; data obtained .to develop client's plan, ! 

_b. Accurate and realistic interpretation of data (medical, social, 
psych , oconomu; ) . 

^' orSr^'^" '^"'^ involvement of client secured, as indicated on 

Appropriate vocational objective selected . " 

0. Conflict(s) between vocational objective and other infonnation 

in case record resolved. 

Sufficient services provided for in IWIiP. 

g. Similar benefits considered and pr(,^vided whore appropriate. 



COMHf.JiTS: 



tS S IN , 

□ □ □ ■ IV. SUmC JlNT :PLAN TO CLOSURi: DOCUMENTATIOH *' 

a. Timely decisions and services deliverer, from plan lo closure. 

b. Adequate infonnation to dos.cribe client's situation and prooress 

ft0!i\ plan to clo.sure. •• ' ■ • . 

Sufficient services prov'idcd for durincj plan. 

^: Sufficient placement assistance provided. 

^' Closure appropriate, accordinc) to RPH cri teria . 

f; Closure timely. • 

COKlLf.'TS: 



tS S IN 

□ □ □ V. CAUSALITY: APPROPRIATE CLOSURF: 



Job placement appropriate and coiitnensura te with client's capabilities 

(Status 25) . V 

b. Adequate effort made to contact cl icnt before c1osin{] case (Status 2^) 

c. OR services had a significant impact on removi nq/reducinq client's 

vocational handicap.' - .j 



CO'-lMF.NTS; 



cdVp*Sco front 



INSTIUICTIONS FOR COMI>l'.L-TFNG Qi:!" 



Probii tie nary oniployoo: Complotti QFJ* on all car,os\ 

Ponnaiiont employee: For those oniployccs whoso last evaluation 

was rated below standard, complete Qi:i- on 
all cases, 

For those employees whose last evaluation 

was rated standard or above, complete QliF 

when case beinn ra*ted is rated as "exceeds 

standard" or "improvement needed". 

^ot^tion Should H o Complo tod 

Section I when client is placed into nov/ extended evahiation plan. 
Section II if Status OH closure from 06 or at plati approval 
Section III at plan approval. 

Section IV at time of Status ?.G or 20 closures. ' . 

1. Complete identifying infonhation 

2. Check appropriate box for each section as "exceeds standard" 
"standard", or "improvement needed". If section is rated as' 
"exceeds standard" or "improvement needed" check appropriate 
roason(s) listed below. Reasons checked should be consistent 
with overall rating. 

3. Use the comment space if "reason" is other than listed. 

4. Coiinient is necessary; 

. a. If any legally required information is missing 

rLolvod.'^ conflictino infonnation which has not been satisfactorily 

c. If information in case is not adequate to describe client's situation 
or progress . ... ■ 

5. Initial and date only sections completed. 
Oefinitions 

txceods Standard: Definitely exceeds standard evpoctaiions in 

spi-'cific,. identifiable areas. 

Standards: Average or fully meets expectations. 

Improvement Needed: Definitely below standard expecto, I ion:; in 

specific, identifiable areas . 

.1— I- 1 iTrrT.w,,^,, ' ^ "t 



OEF OEFINITIOtIS 



I. Appropriate ExterKlod evaluation Plan 

Tj-yly Ooclilon^ jnd S«rvlcc^ Ofllly.trffd f rom Rofffrral'tn tx t eiukd EvaUu tlon: Dncljlon to placo cllfnt Into 
e.xtenacJevTn;itToirp1.,n ino InUI.Ulon ofTTteMdod ovaUi.uTon servlcuf. m'allo" h< tl.out undun \ia\.yy. 

Evidenc e that ni qlbilltv Dptormlnatlo n cannot hff wdn withnut C.ttffndc.l CvahMtlon ! Case recoallno Uates 
reaion roanbilUy cannotTflniotL-narnoin ' i.«-ui«.nj :>tni.c5 

Erj emlrd Evaluat i on Plan U Sufficient tn nrtennlnf Eliglhllltv: " Casa Rocordlnq pi-ovldcj a description of 
wnat services are necessary, alon., a presTFired tlnSHna. b dotermlM client's rehabilitation potontUl. 

II. Appropriate EHolbllUy Octormlnatlon 

Ilj yly O.K l^lorTi and Sc rvlc.!S Oollvprc^^ frr w Referral to Acceptanc o/CloM.rn. Appropriate decisions were 
rp^ah^^rby^aTe^Pnlln^'.''^''''""''^ ^''"'^ -thori.^lk-IEH^p table tL ll.lt. or olhr^^Uu . 

Aoot2nrU_t«^EAjwlr^^^ Re<lu1red medical and specialty exams were obtained 

.nV' ''V'':'-' ^[H'^^'^Hy exams ncrciefl to certify blindness, deafness, mental retardation 

anU appropriate consultation obtained. ♦ "oiiun, etc.. 

f^-£:-^j:A^«"li!Lj_\'^ '^' ^ 4lt4:^L''t^^ QI* Olag nos tic Data ! Diagnostic reports, such as M specialty exan-. and 
psycn leTrrn.). accuratoly Tolervrtted and utnizcd to determine eligibility. 

t^^'^^^tUl"" ''te: Decision to accept or reject client for services Is consistent with Infonna- 

T.!Si fT^ n m'^"^,?? docu^nsnted evidence of a disability, vocational handicap and 

fi-aslblMty; cortt fl cation of ollqiblllty Is complete. .All required legal docu:nentatlon In case record. 

Adequate t..'omatlon In^ Cas e tn Cer tify EllglhlHty: Tho collected and recorded Infomatlon In the client's 
«M on'?- ' ''"•'i"'"' ^° -.uppornite ba^is for'el Iqlb 1 1 1 ty . Any questions regarding the client's 
ellqlblllty for services arc resolved In case notes. 

III. Appropriate Rehabilitation Planning 

O^^i^nr A11 medlcal. social, psychological, financial, educa- 

tional . ana vocaiiutvSTinnrnfoLlon nccesfary io develop tho IWHP was obtained. 

^"V.':iL'l_'!IL<L?illi'lL'^-Jjli^^ Data collected was assessed accuratoly and realistically 

ut.l.(;c<i in p. an dcvoloixwnf. mcon-.Ts timcics bet>vQen datj and vocational objective are explained. 

f«yJJiL"_;l!llL-'^^ There fs evidence that the vocational 

otijcctivo -as an-ivud at by nnitual agniciixint Detnveen the client and counselor. 

'^"I2^i:!i;^_^JI^^'lilL'j.tr^^^^ Vocational objective Is consistent with 

|he-TIuM,rs-rnlcMen.s. capatmriu.,. limuat.ons. and econor.ic circumstances. Objective Is continent with 
the Oep4rt.-ncnfi policy on t)\c onler for selection of services. >-"nii5tcnc wim 

[nrtrei^'l'r'TeSroS'n caseTteT'"" -'-ts. psycnonJTi^T^ports . school trans- 

S^C?{llriLqjIIl!£n.-f P!:?yJ4';d in IwnP: Ad.jquate services, such as. training, tools, transportation 
iuypn.;i. etc.. au thori :ed aiKl pruvnied to lnsuro_ successful co.Toletlon of IWRP. • ' 

Similar 3eneflts Considered and Prnvlded Where Appropriate ; Similar benefits check list cotin^leto. DU 3.10. 

IV. Sufficient Plan to Clqsunj Documsntatlon 

Ilf!?L^_tV5jllon%^^^^^^^^ D,Hn<) plan status, problems were Identlfl.-d 

early; accuions woru maiiooi- services leHver-«tI wTtliout doTay. >ucniiri..u 

i^i-^.L^',lnJr-^i!fl".q.^";y-L^^^ Slf.iatlnn and Pnigr.r.s from Plan tn ClnMn--: Tho collected an.l 

ruconkH. .nro,T,ation ui c.ise riHuer rrcm plan In i tiacimTto 7:^?i^-Tlo.T;7TirTumcl ent to describe 
cHent s situation, pt-ogress. and rationale for counsnlor decisions. 

l"l'Ji^lrr±Sl[:'JSr^Zr^:di^r:^^ client's nei^li for counseling and additional support 

services during pian status wum evaluated and provided v/heno appropriate. 

I'lCj.d-'lJA.^-'JSrtyj t , As s 1 sja nee^ Recording Indicates that appropriate efforts have been made to help dlrnt 
obtain suitJUle CTployment. 

CLoAV.':::j.ni'i2£':!'l5'i.: Rehabilitated (Status 26) or non-rehabilitated (Status 20) closures wore appropriate 
consiilcnng c.-iteri.i set forth In the RPM. • , 

ClosureTlreUi: Rehabilitated (Status 2G) or non-rchnbi 1 i tated (Status 20) cases closed In a timely mannrr. 



EMC 



(^''^If-OfilllA f,t/,T(; DEPAKlMCHT OF f!i;ii.\!l!l,li/jion 
CAfiCLOM) ACTIVITY l,ir,lI(iG 



LAST 



ClIEHT NAME 



CURRIiMT STATUS 13 



ClIEHT 


1 RCI' 

1 L/M 1 L 


PROJ 
V w ij i; 


UlbA 


1 C U 
\ 1 .A, 


'\ R i: 

1* r f 

YA 


II T 
f)5l)I 


FED SPEC 

1 IF 5F 51) 


PROG 1 CHHG 
OlHtK 1 DATE 


A 
w 

I'lO. 


1 COI'lPl 

1 DA It; 


* 


1 U/75 




'51(1 


1 nrc/it 

1 Vi^tsW 


At 


HI) 


5F SD 


1 12/75 








1 12/79 


A28 




1 iiniir 
1 nunc 




01; 


SD 


1 02/80 


13 


1 06/81 


1 


1 [1/1/79 


Ml. 0 




1 tifltit 


110 


HO 




1 03/80 


12 


1 10/80 








t A 

520 


r lioiiii 


HO 


HO 


1 


1 02/7fl 


37 


1 03/78 




1 12/78 


518 








nu 


51) 


1 


21 


1 12/fiO 




1 11/77 


J i 0 




1 DISAD 


AL 


NO 1 


5F SD 


1 08/79 






^65-7896 


1 06/77 




'"Oft 




11 n 

nu 


wn 1 
IIU 1 




1 11/77 








1 03/79 




J c u 


\ nUfii: 


iJn 


kin 1 




1 05/79 


22 


1 08/79 






a 7 


/In 

639 


' HOHI: 


HO 


HO 1 


50 


1 11/50 






w « f 1^ I, U 


11/79 






NflHf: 


HO 


HO 1 




PO 1 12/79 


15 


1 09/80 


U J A U J f 


n /. / 7 0 




1 1 rt 


IIOHE 


1(0 


HO 1 




1 06/79 


'21 


1 12/79 




07/79 


518 








Dt 1 


SD 


1 07/80 










<iifi 


C 1 A 

530 


PISAB 


AL 


HO 1 


■ 5F SD. 


I 02/81 






|-l;5-1803 


0'(/7') 


A28 


51 (1 




lul 


flU 1 


SD 


1 07/79 








03/80 


A23 


5?(1 1 


iiniip 
nuMc 




hT 1 
01 1 




1 O'l/SO 


11 


1 09/80 




01/76 


APR 


JiiU 1 




kin 

NO 


HO 1 




1 0'i/76 






u 0 in// 1 


n Q / 7 
U 7 ^ / ♦ 


A CO 




AFDC 


NO 


HO 1 




1 12/7'i 


75 


1 12/76 


-76-61'i6 1 


OJ/80 




Jul! 1 


rlUnc 


NU 


NO 1 




1 05/80 


10 


06/51 


•ZZ-'iU'i 1 


11/78 


A25 




U 1 ^hQ 


Al 

AL 


liU 1 


SF SD 


1 05/79 






■20-81J1 1 


12/77 


A2a 


522 1 


mm 


NO 


HO 1 


50 


1 02/78 






-5'i-7205 1 


03/77 


A28 


52(1 1 


\\m. 


HO 


!)I 1 


SD 


1 12/79 






-80-J377- 1 


02/78 




S30 1 


\\m: 


HO 


HO 1 




1 ri/n 


3(. 


io/;s 



YES 



ij^'AREO DY ADMIIIISTRATIVE SERVICES 



DISTRICT 110 S/.HTA ROSA 
CASELOAD 226 



C SPECIALTY ; AL 



21 



RI:I'!!R1 PERIOD I'lAR Pii 

.':f:pur:i % n-ou 




STATU l)1:rARTMI:NT or HDUCATION 



OlVI^ilON OP VOCATIOMAl. Rlill AIULITATION 
600 ASYl.UM AVIK llAKTPOKM), COJ^NllCTUrti I' 06105 



STATE OF CONNECTICUT 




Juno 2, 1981 



Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 



Dear Ms. Stoddard: 

In response to your letter requesting materials on case flagging and 

quality assurance, enclosed are a number of items currently in use in our 

agency. In some cases bclo'w, a description of a procedure is provided in 
lieu of an attachment. 

C ase ^^tiq qiinc]^: 

(a) The agency's computerized services notify counselor and 
supervisor a year after closure for cases closed because 
of severity of handicap, so that the such cases may be 
reviewed. 

(b) Counselor and supervisor are also notified annually for 
three (3) years following closure for all cases where the 
client was placed in sheltered employment. 

(c) The computer provides a number of interrelated reports 
wliich help identify delay in case movement and point up 
their caseload characteristics (attaclied): 



1. S D Sum mary - 

"(iinoiithiy) "shows numbers and percents of severely 
disabled, compared to counselors' total caseloads 
for statuses 00-24 and 10-24. 

2. Master File - 

(moii'tfinyl a management tool which indicates case 
status movement, case-by-case, for each counselor. 

3. Counselo r Sta tus Count - 

^month'Ty) provfdos total number of clients for each 
status, for each counselor. 

4 . Cumula t i ve Montli ly Report - 

TmontlTlyl c6ntral;ts selected status counts with counts 

for the same time in tlie previous fiscal year, by district. 



EKLC 
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5. Summary Report - 

(monthly) keeps a running total on referrals, 
acceptances and 26 closures. 

6. RSA-13 - 

(submitted quarterly) includes a narrative which 
analyzes statewide performance in relation to 
annual goals. 



Quality Assurance : 

(a) The most recent report on the secretary's general standards is 
included. 

(b) Assumption College RRCEP, Case Review and Caseload Review Process 
This instrument (attached), developed by Region 1 RRCEP, was adapted 
for Connecticut by staff of DVR and Assumption College and is 
currently being used as part of the counselor evaluation. Also 

used IS the Individual Performance Objectives Plan (IPOP) (attached), 
which is used for counselor goal setting and evaluation. 

(c) In order to insure that appropriate services are planned and 
delivered, the following reviews are made: 

- all Individual Written Rehabilitation Plans (IWRP's) are 
received and approved by the counselor's supervisor. 

- all IWRP's which include physical restoration services are 
reviewed and approved by the District Medical Consultant. 

- all cases which require psychological reports as part of the 
evaluation process are reviewed and approved by the Agency's 
Chief Psychological Consultant or the District Psychiatric 
Consultant. 

Forclarification on these reviews, see Chapter 62.141 of the 
Counselor's Manual, "Required Specialists Evaluation", is 
attached. 

(d) Materials from the counselor's manual are attached which cover the 
following procedural matters: 

- Certification of eligibility for SSDI/SSI Fund Expenditures 
(Chapter 61.162) 

- Certification of Homemaker Eligibility (Chapter 63.110) 
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- Feasibility of a small business project (self-employment) 
tor the client; a series of questions and other planning 

mater-ia-ls-from-Ghapter 66.660 are attached. 

- Feasibility of college training; guidelines for determinina 
Whether planning for college is desirable are attached 
(Chapter 66.320) 

We hope these materials will be useful to you in your efforts. 

Very truly yours, 



Arline E. Bole 
Rehabilitation Consultant 



AEB:11 
attachments 

cc: Judy Richter 
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State of Delaware 
Department of Labor 
Division of vocational Rehabilitation 

Seventh Floor • State Building 
B20 French Street 

Wilmington. Delaware 1 9801 • Telephone: (302) 57 1 • 2850 

April 28, 1981 



Ms. Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, CA 94703 

Dear Susan: 

This is in response to your letter dated April 1, 
1981_to Mr. Barker, our Director, requesting material we 
use in our Agency for case flagging and quality assurance. 

We have enclosed the following: 

1. Delaware VR Casework Manual page 106 on 
flagging and other pages of the Manual 
regarding quality assurance; and 

2. A sample of our EDP-produced reports 
. with some flagging data highlighted. 

Our Casework Supervisors review cases routinely at 
statuses 06, 10, 12, time of IWRP amendments and at 
closure (all statuses). 

Our SSDI/SSI Coordinator conducts a review of those 
cases at the same statuses (less 08 closures) and also 
for post-employment services where SSDI/SSI funds are utilized. 

Sincerely, . 

Earl C. Tuberson, Program Evaluator 
^^^n^ Planning, Monitoring 5 Evaluation Unit 

Enclosures 

cc. B. Barker ) 

G. Veach ) letter only 
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STATE OF FLORIDA 




DEPARTMENT OF 



Hob Graham, Governor 



iiiv^ Health & Rehabiiitative Services 



1317 WINEWOOD UOULEVARD 



TALLAHASSEE, I-LORIDA 32301 



PDVR 



March 25, 1981 



SUBJECT: Instructions for Implementation of Performance Review 



TO: 



District VR Program Supervisors 



Th2 Vocational Rehabilitation Program has built its participation in the Performance 
Review System upon the use of the Case Review Record and existing statistical reports 
such as the VR 100 and Casework Consultants report. Twelve standards are included 
in the Performance Review Manual for VR. The District will report on three of the 
standards (8A-1 , 8A-3) and the Program Office will report on the remaining nine 

standards (8A-4 through 8A-12). The District Program Supervisor will now transfer 
the totals on the Case Review Record into another reporting format. This will be 
the only major change from the current Quality Review Process. 

The Supervising Counselors will continue to complete the Case Review Record on each 
case at acceptance and closure. For this reason, our sample size is 100 percent. 

The Supervising Counselors will submit monthly the carbon copy of each Case Review 
. Record completed for the month to the District Program Supervisor. A cover sheet 
which totals the "yes", "no", and "N.A." column for each item on the Case Review 
Record should be submitted. A monthly narrative report is no loncier required. A 
narrative report should be sent whenever the case reviews indicate problems, trends 
or other information that should be brought to the attention of the District Program 
Supervisor. 

The District Program Supervisor will take the information received from the Supervising 
Counselors and transfer the totals to the attached forms entitled "Performance Review 
Agreement Summary", and "Performance Review Report." This should be done in the 
District Program Office and not by the VR Supervising Counselors. The completion 
of these reports will be discussed at the meeting of the VR Program Suoervisors on 
April 1-3, 1981. 



The items on the 
1,3,5,9,10,11,13, 
should simply be 
checked "yes" and 
"Client scheduled 
in under item 8B 
number 30 in the 
is also space for 



Case Review Record that reflect the quality of services are numbers 
15,16,18,19,24,27,29 and 30. The total, raw numbers, for the month 
transferred. In other words, if your district has a total of 30 cases 
5 cases checked "no" on item #1 of the case review record which reads; 
for an initial interview in a timely manner;" then you should write 
1 on the Performance Criteria Agreement Summary under "Totals" the 
blank space for and the number 5 for the blank- space if-. There 
the unit totals. 
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The items on the Case Review Record that pertain to compliance are numbered 2/,, 6, 7, 
8,12,14,17,20,21,22,23,25,26,28,31, and 32. A case will meet the standard when all 
items are checked either "yes" or "NA." If the file is reviewed at acceptance or 
closure and an item checked "no" can be corrected by the counselor, the item can be 
changed to "yes" after that item has been corrected and noted by the Supervising^^ 
Counselor. The total number of cases in which all items are checked either "yes" 
or "NA" . will go in the i!f+ space for standard 8A-1 on the "Performance Review Report" 
and the cases with items checked "no" will go in the H- space. 

'2q 



The information for standard 8A-3 will be obtained from item //28 on the Case Review 
Record. 



The Program Supervisor will complete Section 4 (corrective action) when indicated by 
the results of the case reviews. 

The peer review will continue as a validation and training session- Because 
Districts are going to be phasing-in the Performance Review System, no peer review 
will be required for the quarter ending March 31, 1981. The only report on the peer 
review will be a narrative report by the Program Supervisor. This will simply be 
an assessment of the cases and analysis by the Program Supervisor. 

In summary, the VR Supervising Counselor will have na additional duties in order 
to implement the Performance Review system. The District Program Supervisor will 
be completing a report that requires transferring totals from the Cose Review 
Record to the attached forms. We will cover this at our Program Supervisors meeting 
in April. Please call Marshall Kelley at S.C. 278-7301 if you have questions concern- 
ing this process. 




7^ ...^^^^^^^Ji^^^i^^^^ 

J. David Sel lars 
Program Staff Director 
Office of Vocational Rehabilitation 



JDSrKj 
Attachement 

cc: District Performance Review Coordinators 
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STATE OF FLORIDA 



DEPARTMENT OF EDUCATION 



KALPIl D. TURLINGTON 



DIVISION OF BLIND SERVICES 



COMMISSIONER 



UONAI.D H. WKDEWEH 
DIRECTOR 



2640 EXECUTIVE CENTER CIRCLE. WEST 



TALLAHASSEE. FLORIDA 32301 



June 2, 1981 



Ms. Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

In response to your request for materials used by this agency for case 
flagging and quality assurance, it should be mentioned first that we use 
two systems. The first is standard procedures which are routinely followed 
and the second is special efforts to solve particular problems or to improve 
performance in a particular area. 

Some of the routine procedures are outlined in the attached excerpt from our 
unit supervisors' manual. Samples of the described data reports which are 
sent to the field offices on a monthly or quarterly basis will be provided 
on request. They are probably typical of client data reports used by most 
agencies. In addition to these written procedures we routinely conduct the 
following reviews for quality assurance purposes: 

a) A monthly follow-up on cases closed from active status. Our area di- 
rectors review the closure reports and mail a questionnaire (copy at- 
tached) to each client. These are returned to the area directors for 
any action needed and then forwarded to the VR program office along 
with the closure documentation. They are reviewed and a monthly sum- 
mary is sent back to the field. 

b) Quarterly review of IWRP's. After IWPJ^'s are approved by the unit 
supervisors a copy is sent to the VR program office. These are re- 
viewed and a quarterly summary of comments and suggestions is sent 
out to the districts. 

c) Authorizations for purchase of services are routinely checked and a 
quarterly report sent out to area directors. This provides a check 
on fiscal procedures as well as a means of assuring that vendors are 
paid promptly. 
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Susan Stoddard 
June 2, 1981 



d) Undue delays in statuses are monitored at the state level as well as 

locally. The one-page case review form (copy attached) which is used 

routinely by unit supervisors and state staff records dates for various 
steps in the VR process. 

in addition to these on-going procedures we review client data periodically 
to spot problem areas and develop a means of determining causative factors 
as a basis for corrective action. Recent examples include a review of eli- 
gibility decisions, and a review of cases closed not-rehabilitated. Copies 
of the review forms are attached. 

If you have any further questions please feel free to contact us. 
Cordially, 

DIVISION OF BLIND SERVICES 




Donald H. Wedewer 
Director 



DHW/CiM/EF/pk 
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^t&^pj DIVISION OF BLIND SER VICES 

' Depart mem of Education 

State of Florida 

RALPH D. TURLINGTON _^ .J<=;: y^') i , DONALD H. WEDEWER 

COMMISSIONER v> V ' / , ? DIRECTOR 



/ 
/ 



AS A FORMER CLIENT OF THE DIVISION OF BLIND SERVICES, YOU CAN HELP US TO ENSURE 
THAT WE ARE PROVIDING SATISFACTORY SERVICES. WILL YOU PLEASE ANSWER THE FOLLOWING 
QUESTIONS; ADD ANY COMMENTS YOU WISH, AND RETURN THIS QUESTIONNAIRE IN THE ENCLOSED 
ENVELOPE? YOUR REPLY WILL HELP US IMPROVE OUR SERVICES AND WE WOULD APPRECIATE 
YOUR COOPERATION. 



1, PLEASE CHECK THE STATEMENT THAT BEST DESCRIBES YOUR PRESENT ACTIVITIES. 

: I WORK 35 HOURS OR MORE A WEEK AND EARN $ _A WEEK. 

I WORK LESS THAN 35 HOURS A WEEK AND EARN $ A WEEK. 

" — I AM NOT WORKING.' " ' - - . 



I AH A HOMEMAKER AND DO NOT WORK OUTSIDE THE HOME. 



OTHER. PLEASE EXPLAIN 



2. WHEN YOU WERE RECEIVING SERVICES FROM THE DIVISION OF BLIND SERVICES YOU HAD 

A COUNSELOR. WAS YOUR COUNSELOR WILLING TO LISTEN TO YOUR IDEAS AND SUGGESTIONS? 

YES NO SOMETIMES 



3. - DID YOUR COUNSELOR EXPLAIN WHAT THE DOCTOR'S REPORTS SAID AND MEANT? 

• YES N O S OMETIMES 

4. ARE YOU SATISFIED WITH THE MEDICAL SERVICES YOU RECEIVED? YES NO 

5. DID YOU RECEIVE SERVICES QUICKLY? Y ES ^NO . ^SOMETIMES 

6. DID YOU RECEIVE TRAINING? YES NO 

7. DID YOU AGREE WITH YOUR COUNSELOR THAT YOU SHOULD NOT CONTINUE TO RECEIVE 
SERVICES AS A VOCATIONAL REHABILITATION CLIENT? Y ES NO 

8. DO YOU NEED EYE MEDICAL CARE FOLLOW-UP?. _YES NO — 

9. DID YOUR COUNSELOR REFER YOU TO THE MEDICAL AND SOCIAL SERVICES PROGRAM OF THE 
DIVISION OF BLIND SERVICES FOR EYE MEDICAL CARE FOLLOW-UP? ^YES NO 

10. WOULD YOU TELL A BLIND FRIEND WHO NEEDS HELP TO GO TO THE DIVISION OF BLIND 
SERVICES? YES . NO 

PLEASE ADD ANY COMMENTS YOU WOULD LIKE TO MAKE, GOOD OR BAD, ON THE REVERSE SIDE. 

THANK YOU. 
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SIGNATURE 



•VOCATIONAL REHABILITATION CASE REVIEW FORM . • 
fjtus Counselor Reviewer Dates • ' 



Client ' D.O.B. Disability 



••; . Referral Date . '. '. ' Master List Codes Missing or 

Incorrect 

GO . Client Seen (date) Eye Exam (date)__ 



02 . Application, VR4 & Treatment Agreement, Diagnostics (Comments).- 
06 • R5A1. (Date) Codes Incorrect (Item #) ._ 



10 . . Ceirt. . of Elig. or Ext. Eval'. (Date) 
12 • 

• Case Study Analysis (Comments) 



IWRP;. Voc. Objective^ ^Content (Comments) 



Ext^ Eval.. or iWRP Review (Dates) 



lA . - C^ality of Services -.Provided (promptness - suitability , use of 
16 similar benefits , vocational counseling, placement assistance, 

IS etc. : ■ ' ■ 

20 . ~ '. '■ ~ ^ ~ 

22 



24 Reason Services Suspended_^ Date 

Client contacts • . 



26 ■ Closure Info and R5A-2 - Complete C orrect . . D ate 

90 Comments •. • • • ■ " ■ - ■ 

40 • Closure Reason • Referral Source Informed 

50 ~~7"^ " '■ 

60 ' ■ Documentation Adequate? • • 

70 • [ ^ [ r r 

80 Special Programs (SSIP. ^iJSDI, CSP) Comments 
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KEVIH'/EIl: 



DATE: 



PART I-ELIGIBILITY DATA 

Does the diagnostic studj' to establish eligibility - 
include: 

la. An appraisal of the current general health status 
6f the client, and if his/her disabling condition 
necessitates: 

An examination by a physician skilled .in .the 
diagnosis and treatment of mental or enotional 
disorders, or by a psychologist licensed or • 
certified by the State? • 

An evaluation of visual loss by a physician 
sldLlled in diseases of the eye or by an 
optonetrist? ••■i'.' ' . • • 

An evaluation of hearing loss by a physican 
slcilled in diseases of the ear or by a licensed 
or certified audiologist? 

A psychological evalmtion that includes a 
valid test of intelligence and an assessment 
of social functioning, and educational progress 
and achievement? 

lb. An evaluation of pertinent medical, psychological, 
vocational, educational and other related factors 
describing how the client's disability constitutes 
or results in a substantial handicap to emploi'ment. 

Is there sufficient documentation in the case record: 

2a. To establish the presence of a physical or mental 
disability vMch for the individual constitutes or 
results in a substantial handicap to employment? 

2b. To substantiate a reasonable expectation that 

vocational rehabilitation services may benefit the 
individual in terms of onployability? . 



(1) 

(2) 
(3) 
(4) 
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j CASE STUlJY ANALYSIS 
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AKflNISTRATIVE REVIEW 



Reviewer: 



Client 



_Specialist 



.. STATUS 00 

1. • R-4 coiiiplGted pro\ erly? Yes No 

Contacts tiniely or on-going? Yes No 

STATUS 02-32 

1. Were forms conpleted properly? • 



R-4 

R-300 

R-3 

R-41 

R-52 

R-37 

Other 



_Yes_ 
_Yes_ 
_Yes_ 
_Yes_ 
_Yes_ 
_Yes_ 
Yes 



_No 
_No 
_No 
_No 
_No 
_No 
No 



Yes No 



2. Were timely contacts maintained? 
COtTTEiSrr ; 

3-. Were diagnostics for mental/physical 
disability adequate? Yes ' No 

Specialist Psychological Psychiatric 

Did specialist synthesize information adequately'' 

Yes No 

4. Was client informed of their rights, 
confidentiality, appeal? Yes No 

5. Was case movement timely? Yes No 

6. Appropriate use of Status 06? Yes_ No . 

7. Documentation to support SD? Yes No 

8. Eligibility statement presents evidence that 
client meets eligibility criteria? Yes No 

9. Certificate of eligibility signed and 
- dated? Yes No 

ERIC 
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Date 



COMtffiNTS 



f • Was client contacted during job placement? 

Yes No 



g. Was RCR closure information complete? 

Yes No 

Was Post-Enployment box on Il*3RP checked 
appropriately? Yes^ No 

17. Post Biployment Services: 

a. Were they given appropriately? 

Yes No 



b. Forms conpleted correctly? Yes N o 

18. Was the case supervised appropriately? 

Yes No 



19, Were fiscal matters handled adequately? 

Yes No 



20, Was clerical support adequate? Yes^ No 



21, Were RCR entries neat, concise, and conplete 
enough to support services being provided 
or recommended? Yes No 



(Clip. 6, p. 13) 
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SECTION VI 
Time In Status Guidelines 

« 

The counselor is responsible for assurinp, that each case moves through the 
rehabilitation process in an appropriate manner and that referrals, appli- 
cants and clients are served in an adequate and timely fashion. 
The following chart indicates the maximum amount of time which could reason- 
ably be expected for a case to remain in any one status, under usual circum- 
stances: 



Status 


Months 


00 


2 (F 


■ 02 • 


A (F 


06 


13 


10 


6 


12 


2 


lA 


18 


16 


18 


13 


60 


20 


6 


22 


3 


24 


6 



3 months) 
6 months) 



Counselors should review the Caseload Report Summary on a monthly basis to 
determine whether any case has remained in a oarticular status fcr longer 
than the number of months shown on the chart. If so, the counselor should 
review the casefile to see whether the case is proceeding satisfactorily " 
with no additional or corrective action needed at this time. Any needed 
actions are to be taken as soon as possible, in order to prevent inappropriate 
delay in provision of services to the individual. Hopefully, this monthlv 
review will help the counselor to provide effective and expeditious services 
to each person on the caseload. 

The Counselor Work Record and other documentation in the casefile should 
a^vavs reflect current activity and rationale for a case bein^ in a particular 
status regardless of whether the "time-in-status" Ruidelines'are exceeded. 
Cases vhich remain in a given status for an excessive period of time will be • 
reviewed by the Area Supervisor to determine whether there are problens In- 
volved in the management of those cases, and if so, what corrective actions 
are needed. 
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I. OBJECTIVE: 

4 



METHOD: 



Random Sample 
Action Plan 

To improve consultation services in relation 
to diagnostic study and certification. 

Area Supervisoor vill provide training to A.M.C. 
utilizing thH-xeci—tiy developed training . 
raaterxr:^.. 
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Rica: 



mt the mini training ses- 



L::ar::::an of Medical Consultation" to 



METHOD: 



aisollng -raff ar d AMC. 

Area Supervisor will review written consultation 
provided by the AMC for at least 3 months following 
training and provide guidance as needed. 

EVALUATION: Q.A. specialist will review the diagnostic study 
and certification on a sample of cases in which 
medical consultation was provided, following the 
training and assess whether improvements have been 
made since the last review. 

2. OBJECTIVE: To evaluate the effectiveness of work evaluation/WAT 
programming provided to VR clients in XYZ Facility. 

Q.A. specialist will review a sample of cases on 
clients who have been clients of XYZ Facility and • 
provide a written report to the Area Supervisor. 

Area Supervisor will meet with facility personnel and 
together they will outline any needed corrective 
actions. 

Q.A. specialist will return after an appropriate 
length of time and will review a new sample of 
cases that have gone through either work evaluation 
or WAT. 

To improve the quality of the written rehabili- 
tation plans. 

Mini-session on plan writing to be presented by 
Dottie Rice to counseling staff. 

Counselor X working with Counselors 1-6 
Counselor Y working with Counselors 7-13 to 
assist with plan writing. 

Lead Counselor review of plans for A months. 

EVALUATION: Q.A. specialist will review a random sample of cases 
in status 12 since plan writing sessions. 



EVALUATION: 



3. OBJECTIVE: 



METHOD: 




Action Plan 



OBJECTIVE: To improve general case management of caseload 
' 11999. 

METHOD: Q.A. Specialist to review entire caseload and 

provide report to counselor and area supervisor. 

Area Supervisor and counselor devise corrective 
action plan with time frames established. 

EVALUATION: Q.A. Specialist to review a random sampling and 
assess extent of improvement since full caseload 
review. 

OBJECTIVE: To improve written certifications by counseling 
staff. 

METHOD: Dottie Rice to present "Diagnostic Study and 

Certification" mini sessions to counseling staff 
at area meeting. 

EVALUATION: At the end of three months, Q.A. Specialist returns 
to review random sample of recently certified cases 
to evaluate effectiveness of training and review. 

OBJECTIVE: To better utilize TF/SF money. 

METHOD: TF/SF Supervisor will present refresher training 

on TF/SF procedures. 

TF/SF Liaison will review a random sample of TF/SF 
cases on each caseload for a period of six month 
following training. 

EVALUATION: Q.A. Specialist and TF/SF Supervisor will feview 
a random sample of TF/SF cases. 
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CASE REVIEW GUIDELINES 
Division of Vocational Rehabilitation 
April, 1980 



Case Processing 

A. Applicntion/Diap.nostlc Study 

- Check for signature of applicant. 
Check reported disability. 

Check time in statuses on anri no t . 
^ A,.« 4 II i>Lcicuses uu and U^. Is case moving on a timelv hpQTQ? 

B, Certification . 

^"Ability/Substantial Handicap to Employment - 

I S'^LT'"'' ^^'^ ^^'^^""'^ '^^^^^ Is disability confirmed' 

- Is the diagnosis provided by the "appropriate" doctor e ^ i, , 
mental disability confirmed by a psychoLoist or a ps* hla^kst 

- Are functional limitations either specified or obvious' ' " 

- Is there an assessment of the applicant's current health' 

" ^ene"arjedic.r'°"^ °" "'°"'^hs, now foV 

gene.al medical exam) prior to application' 

Is substantia _l handicap for that individual conFirm°H7 
Reasonable Expectation - 

to^io^e^^'^^"'"^'"^'"' ^ double-check any other fac- 

- Assess. lo£ic for certification into 06 or 10 (check review date on 06). 
SD/NSD - 

- Check certification against CSR coding. 

• "IL^^.r^"" explained in RSAVs_tcrms and is this "backed, up"' 
" TP vcn"" ^""'^•■^'^^ 3-diRit code number used on CSR? ^•"P ' 

- If NSD, IS tliis correct? * 

Check date and status on CSR/CWR to match.with Certification. 
. Plans 

1. Written plan • • , 

I Ch^L n%'Jr ^^P"^^-•^y^^" CcrUficntLon and initial Plan of Service 
Eoa" cSefr '^^^'^^"^^^^ -'"d explanation of vccalional 

is a Review date srlincl.ilM.I? To -r^ p^^rccL" ' 



-2- 



ERIC 



Vocntlonnl ^;onl - KohabillLntion/KxtcncIcd Evaluation. Is Roal fon.fh7.7 
.(Is son! for lixtendod Evaluation "To bo dotennincd") Check CWR^^?^ 
■ L'nd "'^^ transcripts, etc. plus explain ion o ^ubs^nntS" 

handicap on Certification. Does thTvoc^TEional coal t-,kn^n^o 
such things as current Labor market situations' °^^"°"nt 
♦ m self-e.ploy.ent, have SBE procedures beL^ fallowed? — ^-ci 

Intermedin te OblrrMvns - Are appropriate objectives identified? 

I^^^^^^f - "^tr^^-e of services specified, along with dates/duration' 

Are all,. recommended services included' If nn^ -fo ^K ^ aates/duration? 
on the CWR? included. If not, is there an explanation 

- Do services match objectives? " ' 

■ " J°^"^i"^ "'-^tch diagnostic information and recommendations? 
• If not., check for explanation (usually on CWR). 

giieria - Do they n,atch objectives and services? Are they understand- 
Signatures - Are appropriate signatures on the plan' (NOTE. R«m^ 

2. Follow- Through 

" Scal'rJj^i' - 8"cie reports, medical/psycholo- 

gical report^., , counselor/client contact, etr.) / p y i a.u 

- Are placcmout services being provided «hen appropriate' 
" carder" ""-""ne and guidance" 'sessions re- 

NOTE: Again, clieck status and dates 12 14 16 Ifl on oo ^ o/ 

CSR status should match current activity This'is :x^r;^, ?' ' ^""^ ' 
if caseload management is being done v\'^-strt^u"eran^r ^ngt^ ITllTul as 
showi-» on computer print-out. ■^•^"bi-n in status as 

D. Fiscal Documont s 

- Are past fiscal year's transactions reconciied' • 

- Is present Fiscal Recap Sheet current? ^Are there any outstandinn au- 

- aZiT.r" ^'^f reconciled? Is vendor contac deeded' 

- Check nature and date of service witi, plans to see that we are n^t 
L^rt Mo'"' 'r'^'^'l not included- on plan (usually maJntenance^t^ans- 

' lllr t ''''"^''^'■^'^^ ^'^^ r.lnssc.s. calculator, etc.) Okay to buy 

short tci-m diagnostics without bolng on plan. ^ 

" Hon for supportive, services (maintenance and transporta- 

ci^ok ,T;^ '° ''"^^^^^^^ On more recent ones 

check claim vouchers and sLntcnuMUs on Rb-i . Also, is ".TLl^Zco/ 



transportation" beiiiR used for other Lhi.n«s (tools, tuition, medical 
services, etc.) to avoid time factors and paperwork? 

- Have proper procedures been followed for oral authorizations' 

• " ^ijff; "'^i"''"/'^P°'^ts from Drs., PsycholoRists, hospitals, etc. with 

billings, claim vouchers, and US-l's and double-check dates of re<5pec- 
;tlve documents. i.<-. pc<- 

' " "j"''j^PfJ^^''^l"^^°"^/"'^°"""<^"''a""ons for physical and mental restoration 

- Check for client receipts, when needed. 

- Proper signatures on RS-l's Area Supervisor/State Office, when needed 

- Excessive back-dates? If so, is there a common reason? Are there jus ti- 
fxcation memos? jusci 

- TF/SF/Title I Is program appropriate? (See below). 

-'Have appropriate cliargebaclcs been done? 

- Has BI-OG, State Scholarship and other similar benefits been pursued, 
when appropriate? . ' 

E. Trust Fund/Security Fund 

- Check counselor survey form and TF/SF section regarding Social Security- 
disability benefits. If not receiving SSDI/SSI, just make sure RS-l's 
are for program 1 and that CSR Line C is current. 

If receiving SSDI/SSI, 

- Check Line C of the CSR to see that it is current 

- Check request for verification on 1407 or 1^08 (allowances only). If 
DD referral, is packet in file; has 1407 been completed? " 

" li ^%"v/j^^^''^' ^""^ " ^" ^^^^"^ 1°"^^ than 12, check to see 

that It/SF money is being utilized. All beneficiaries are eligibla 

tional goal'. ' '""^ eliminated as possible voca- 

" ~ It '^Jll/ir ^""8 "^^^> ^^'^^^ Strong likelihood document. 

- Check TF/SF Lntitlement coding on CSR. "S" if tF/SF is being spent 
below status 12 and "B" if no TF/SF is being spent 

- If beyond 12, check to see if entitlement code reflects case service 
funding status: 0-Not Allowed SSI/SSDI, B-Benef iciary during VR process 
but not currently eligible for TF/SF, no supportive documentation or 
doesnot meet SSn, S-Eligiblc for TF/SF under Strong Likelihood, C- 

i^°^''f V''"u ""'^ '''^^ verification is in file. (C is not 

changed, but "term can be entered.) 

- There should be official SSA verification in file by status 12, but if 
not, strong likelihood can still be used if desirable. If so, entitle- 
ment code should remain "S" on CSR. ' entitle- 

- Check StatcMncnt of Conformance and whothc-r all 4 criteria are completed 
and appropriate if case is in status 12 or above and vocational coal is 
SGA. NOT.: Ul SSI./SSDI -beneficiaries must be certified "L/do'i n^t 
meet SSC and Statement of Conformance must be signed and i oved 
(Certifying a client as meeting SSC does^not necessarily imply that TF/SF 
Is bemj, spent.) j i j /or 

Common Observations of counselor/area practices/problems after review of several 
cases • 

- Check for proper utilization of medical consultati 



on . 



Check for utilization of particular vendors. 

Check for the use or effectiveness of facility services. 

Ql>cck the amount of client contact If mwo L 

tag site, for,,, letters. o.Joy;o„t Suo.tio^naJlr'ejf 
Note the use of any "unofficial" forms or form letters. ' 
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WORK, ACTIVITY/PLANNING REPORT 
I. TWRP Monitoring 



CouiiSiiLur 
Month 



Caseload 



C. Due Next Month 



1. 
2. 
3. 
\\. 
5. 
6. 
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8. 
9. 
10. 



Name uaLe lyF 


563 Date 
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II. R- jl9_ Report 
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Name Date 
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E nthpr Work Activity Plans 



Name Date lU 


563 Date 
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R.lin (Rev. 7-79) 



DURING THE REVIEWING 
PERIOD. ATTACH NOTES 
OR COMMENTS HERE 



STATE CF IOWA 

CONFIDENTIAL PERFORMANCE REVIEW/EVALUATION 

(Managers, Supervisofs and Non-Supervisors) 



NOTE; Please Type or prini 



SECTION A 

RESPONSIBILITIES AND 
STANDARDS/RESULTS EXPECTED 





? iOC SIC hO 


Counselor 


< «{«(NCYMI«MltUfiO^ 

Dept. of Riblic Instruction 


t Division 

1(ESD 




1 i^U^«l«!t(KU| 


ItlfhQiiMiiivd 


9 Vm UkU IN 


to P|H>0Dr.0viHlU||YE<<MUiliON 

^6/1/80 , 5/3V81 


Perforniai 


ice Improvement 



INSTRUCTIONS; Scclion A Is Jo be compleled a! Ihe BEGINNING ol Ihe evalualion period. II MUST be discussed with and signed by llie Individual being evaluated Employee's 
opy s given to Ihe individual IMMEDIATELY lollowlng the conlerence. Other copies are HELD by the Supervisor until the END ol the evaluation peL when they are AT- 
TACHEO to Section B. See separate Instruction Sheet and Manual for detail, 



12. Responsibilities: From job description and classification specification or other. 



No. 



20 



20 



ERIC 



MAJOR RESPONSIBILITIES 



To explain vocational rehabilitation services 
and client rights and responsibilities for 
each referral soon after assignment so that 
referrals liave sufficient information about 
VR services to choose whether or not to 
become an applicant. 



To complete intakes and move applicants to 



13. standards and Results Expected; (Conditions which will exist when the job Is 
done satisfactorily. Several Standards for each responsibility) 



STANDARDS/RESULTS EXPECTED 



A. VR services have been explained to referrals soon 
after the assignment date. 

Method ; Records will be maintained of calendar 
days elapsed from date of assignment tliru date of 
R-H13 entry verifying that services were explained. 
Mean elapsed days per case to be computed. Exception ; 
For transfers in (Status 00), date of transfer 
will be substituted for date of 00. 



Rating: 



flverase days elapsed 



I't or less 

15 to 2l^ 

25 to 30 
31 to 



5 
'J 
3 
2 



l^6 or more 1 

t- " 

B. Each case record mov?.d to Status 02 includes a 
properly dated and si^^ned ,R-2, a signed document 
requesting VR services, or the R-iH3 section includes 
an explanation of the client's refusal to sim an 
R-2. 



Method and Ratinf^ : Any exception, wlien observed 
. and recorded by tlie Supervisor, will reduce the 
otiierwise final rating for Standard A by 0.5. 

A. Each case record moved to Statuses OG, 10, 08 has 



H 



fi3 



12. Responsibilities: From job descripiion and classilicalion specilicalion or other, 



No. 



MAJOR RESPONSIBILITIES 



Status 06, 08, or 10 in a timely manner and 
in accord with the Client Service Manual and 
lYocedural Handbook so that applicants are 
appropriately advised regarding their 
eligibility and the decisions are supported 
by documentation in the case record. 



ERIC 



13. Slandards and Rcsiills Expected: ICondilions which will exist when Ihe job Is 
done satisfactorily, Several Standards for each responsibility) . 



STANDARDS/RESULTS EXPECTED 



been processed in accord with the 1?£SB Procedural 
Handbook. 

Method: Supervisor to apply review form to a sample 
of cases. Review findings to be shared with 
counselor. 

Rating: Percentage 

Adecfuate to Total Scale 

98 - 100 5 

96 - 97 i[ 

94- 95 3 ■ 

90 - 93 2 
0 - 89 1 

Determinations of eligibility, acceptability for 
extended evaluation and ineligibility are made 

reasonably soon after the date of application. 

Method ; Records will be maintained of calendar 
days elapsed from date of 02 to 08, 02 to 06 and 
02 to 10. Mean elapsed days per case to be computed. 
_Exceptions : For transfers in, date of transfer will 
be substituted for date of 02. 

Rating : Average days elapsed 
'I'i or less 5 
'^5 to n 1} 
75 torn 3 
105 to m 2 
■ 135 to 155* 1 
NOTE: Ratings for Standards A & B to be avei^aged to 
establish overall rating for Responsibility 2 (car- 
ried to 1 decimal]. 



* Delays in processing due to Agency funding 
problems or unique circumstances are to be 
handled in accord with Supervisory Handbook 
[nstructional Memo dated 5/21/80. 
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12. Responsibilities: From job description and classilicalion specilication or otlier, 



MAJOR RESPONSIBILITIES 



13, Standards and Results Expected: (Conditions which will exist when llie job is 
done satislaclcrily. Several Standards lor each responsibility) 



STANDARDS/RESULTS EXPECTED 



20 



20 



ERIC 



.To develop and maintain a timely IWRP with 
each elij;ible client (and OG) which is in 
accord with the Client Service Manual and 
the Procedural Handbook so that planned 
services may be received and client progress 
may be assessed. 



To effect timely placement and/or termination 
of services appropriate to IWRP goals so 
that clients achieve suitable vocational 
objectives. 



Go 



A. 



A. 



Each IWRP R-IA, D and C has been developed and 
maintained according to RESB Procedural Handbook 
and in response to client needs. 

Method : Supervisor to apply "review form" to a 
sample of IWRP's with any deficiencies noted and 
shared with counselor. 



Rating : Percentage 

Adequate to Total 
98 - 100 
96- 97 
n - 95 
90- 93 
0 - 89 



Scale 
5 

3 
2 
1 



Each client determined to be placement ready [Status 
ll^ and 20) has received and/or is receiving in 
accord with the RESB Procedural Handbook such 
placement services as are necessary and available. 

Method : Supervisor to apply a review form to a 
sample of records held in Status' W and 20. Review 
findings to be shared with counselor. The percentage 
of "adequate" to "total" is computed. 



B. Each casefile moved to Status 08 from 06, 26, 28 and 
30 includes documentation that applicable standards 
for termination of service have been met. 

Method: Supervisor to apply a review form to a 
sample of casefiles closed 08 from 06, 26, 28, and 
30. Review findings to be shared with coimseloi.'.' 
The percentage of "adequate" to "total" is 
computed. 



Rating : Percentages earned in A & B above to be 
averaged and rated as follows: 



G7 



H 



12. flesponsibilities: From job dcscripiion and classilicalion specilicalion or olher. 



No, 



20 



MAJOR RESPONSIBILITIES 



To know and adhere to established procedures 
and conduct in the practice of rehabilitation 
counseling so that confidence and respect 
from consumers, the public, other profession- 
als and the employers may be maintained. 



13. Siaiiilai(is and Results Expecled: (Condiiinns which will cxisi when ihe job is 
done saiislaciofily. SeuLval Standards lor feacli iesponsibilily) 



A. 



STANDARDS/RESULTS EXPECTED 



Adequate to Total 
98 - 100 
96 - 97 
94 - 95 
90 - 93 
0-89 



Scale 
5 

3 
2 
1 



Monthly work plans and weekly itineraries have been 
completed, with prescribed time frames, inth 
revision as appropriate, and submitted to supervisor 
for approval. 



B. No established work rules have been violated. 

C. Action plans based on principles of effective case- 
load management and developed in conjunction with 
the supervisor have been carried out. 

Method; Supervisor to review adequacy and time- 
liness of work plans and itineraries, violations, 
of work rules to be recorded. Action plans to be 
written and retained for the evaluation period. 

Rating: Satisfactory performance (3 rating) is a 
minimum expectation. Ratinjrs of 4 and 5 or 1 and 
2 will require specific justification. 



14. This seclion was discussed with me at Ihe beginning ol the evaluation period and The above responsibilities and results expected were develoned bv 
I have been given a copy lor my personal use during Ihe upcoming period. ue'eiupea oy. 



Employee: 



. Dale:. 



Supervisor; 



Title:. 



'tiOrt; Weighted percentage expressed as a decimal (importance of a responsibility 
^j—npared to others. Total 100%) 

ERIC . 



OlSrniOUTlON; 
Held until Ihe 
end ol Ihe 
EvMlon Peiiod. 



WHITE-Eaiployce'5 Copy-uiven Immcdlalely 
CANARY-SupCfvisors Cop/ 
PINK-Meril Copy 
GOLDENROD-Agency Copy 



Date:. 



M-12(3-77) 

fiiV 



CASE 
DATE 

CASEWORK PERFORMANCE REVIEW 
"10", "06", "08" from "30-02" 



1. Intake Data Recording » Adequate 

a. Procedurally correct 

b. Complete 

2. Disabling Condition (s) - Limitation (s) 1 

a. All disabilities described ' 

b. Resulting functional limitations 

3. Vocational Handicap 

I a. How limitations are/are not handicapping ' 

» b. Handicap is/is not substantial 

4-V . Reasonable Expectation 

a. Supporting rationale " • 



5. Certification CR-413 Face Sheet) 

a. Disabilities identified, coded, source, dates 

b. Certification boxes checked, signed, dated _ 

6. Severely Disabled 

a. Correct designation 

b. Supportive rationale as required 

7. Medical Consultation 

a. Reviewed by consultant _ 

b. Issues reconciled 

8. Client Notification • 

a . Done as required 

b. Informed of rights^ 

9. Timeliness-decisions made and actions carried out 
consistent with availability of pertinent information 

10. Form Completion - 

a. SSA-SSI - - - - 

b. R-2/Release 

' c. CSR-300 

11. RE VmVER COMMENTS: 



II. COUNSELOR COMMENTS: Reviewer 
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Date 



Signed 



\ 
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CSN 

CASE 

DATE 

CASEWORK PERFORMANCE REVIEW ~" ■ 

Individual Written Rehabilitation Proqram 
j_ ^ Not . 

T: Reasons for Vocational Objective (or goal of 06) '^^".^""^^ Adequate 

a. Experience skill, aptitude _ b. Interests c. Compatible to disability? 

L^^Vil^l^ St. ?4 acquirements _ f . Assessment of Oob - 

2. Objectives 

a. Procedurally correct b. Include necessary obj"ectivert7achT^Vrg5"al — " 

c. Required (placement) _ d. Criteria for review _ — 

3. Activities . 

^^soSSs^bi^i'tv' ^° H°''''f'r.- ^^■'"^ f^^'^'"3"cr"Acl?o"nltaHiii^ith iiiTiHid 
responsibility __ d. Include necessary services to achieve objective _ 

4. Dates 

a. Realistic b. Procedurally correct ■ 

5. Reviews 

a. Purpose indicated, timely _ b. Pertinent to Objectives'&'Act ivities 

Activmel^as Ld'eS^^^^ a' P^^""^^ activities carried out _ e. New^Objectives or 
06 14 1o h— . • °' 'T''^' readiness — f. 90 Day Minimum (St. 

uo, 1^, ^u, h. Supervisory consultation incorporated Ist. 14 & 20) 

6. Financial Planning/Authorization _ 

JnveSSJJv'as'^imn-^.pH''" '"h "k J^"^^ Funds designated E—FinaHHil 

inventory as required _ d. Similar benefits sought _ e. BEOG TFsponse _ 

7. Placement Resources Utilized (Job ready Statuses 14 & 20) — 

a. Job Services_b. CETA_ c. Training facility_d. In-House_ e. Tax Cred its __ 

8. Process Items----- 

d' Baliffni'plin^MvJv-. ^• .^^^^ ''"9"^^ &"d"aied"i;""criwRP GBn^Hdlcated — 

d. Basis for eligibility checked _ e. Copies to client _ f. Correct status"^ 

^' Jf'"infSrmation^''''°"' """"^^ """^ "'''''^^ consistent with availability 

10. Form completion 

^ n^°J"^^^ i"^^"^' CSR-300) _ b. Training & Prog^ess"reponrobtiiHid " 

c. Worker's Comp _ d. Acceptance forms __ e. OJT description " " 

11. REVIEWER COMMENTS: . "~ 



III. COUNSELOR COMMENTS: Reviewer 



(revised 2/81) Date_jl^ Signed 



CSN 
CASE 
DATE 

CASEWORK PERFORMANCE REVIEW 
"26", "28/30", "08" from "06" 



I- 



Description of Services Provided- 



Not 

Adequate Adequate 



a. Evaluation and diagnosis b. Counseling & Guidance c. Training"^ 

d. Restoration e. Placement, etc. — 

Outcome of Services- --^ 

a. Resulted from VR services b. Services provided SUBSTANTIAL 

Description of Benefits received 

a. Physical adaptation b. Personal adjustment c. Educational 

development d. Economic improvement e. Communication 

Goals and Objectives 

a. IWRP objective met b. Vocational goal met ' 

Closure Rationale 

a. Client employed b. Lost contact c. Other reasons 

:Suitability of Employment (26 ^ s) 

a. Wbrk and disability compatible b. Appropriate work skills c Working 

conditions & disability compatible _ d. Appropriate wage & worki^Tg conditions 

e. Client/employer satisfaction _ f. Employment regular & permanent 

Client Rights 

a. Annual review (sheltered) b. Annual review (2,8 or 9) c^RicTht~6 

administrative review d. Referral to other agency 

Closure and Post Closure 

a. Client views of closure _ b. Job data c. Post employment (explalHid 

purpose and time) v . 

Timeliness-decisions made and actions taken consistent with 
availability of information 

Forms . 

a. SSI/SSDI b. Prosthetics/equipment acceptance c. Face Sheet fO 8 

from 06) d. R-302 — ^ 

REVIEIVER COMMENTS: ^ 



Reviewer 

COUNSELOR COMMENTS: 



7/79 



Date 




Kentucky Department of Education 

Raymond Barhcr. Superintendent of Public Jnxtruciion 



April 9, 1981 



Ms. Susan Stoddard 

Proj£ r D ector 

Berke' Planning Association 

3200 Adeline Street 

Berkeley, California 94703 

Dear Ms. Stoddard: 

In the Kentucky agency, our monitoring for time in status is chiefly confined 
to Ob and 24. Days in status are reported on a monthly computer run as a oart 
of routine information transmittal. We have taken the approach of focusing 
upon outcome of casework rather than process and as a part of this focus we are 
working upon modifications of the traditional status structure toallow the 
counselors greater professional freedom. 

Our Quality Assurance Unit functions within our Division of Support Services 
and has the responsibility of assuring compliance with federal and state reg- 
ulations and policies. Caseload reviews are done on. a district basis, using 
a randomly selected overall sample, rather than to focus upon individual 
counselors. The review team is composed of the two central office quality 
assurance personnel and one member of the field staff chosen separately for 
each review. We feel this adds both an additional measure of field credibility 
and a training component. Tho rr/iew form used is enclosed. At the conclusion 
of the review, an exit staff meeting is held at which a summary of findings is 
given and^discussed. The team's report (along with the completed forms) is 
sent first to the District Manager for reaction. The final report including 
tne reply is circulated among appropriate central office staff. 

Standards used in review are largely confined to the current federal regulations, 
As an agency we have committed our efforts tb quality vocational rehabilitation 
within the regulatory framework rather than any undue emphasis upon quantity 
production. . 

Thank you for the opportunity to discuss our program. Should any additional 
information be required, please feel free to contact me. 

Sincerely, 



Paris E. Hopkins, Bureau Head 
3ureau of Rehabilitation Services 

PEH/MJH/mae 
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Date 



Case Movement 



Status 

00 

02 

06 

08 

' 10 

12 

14 

16 

18 ^ 

20 

22 

24 

26 _ 

28 

30 

32 



Date 



BUREAU OF HKIIABILITATION SKKVICES 
CASK REVII'W DOCUMENT 



Current Counselor 
Office 



District Manager 
Caseload # 



Client's Name 
Case Number 



Referral Source 



Primary Disability 



Secondary Disability 



^Code 
Code 
Code 



Coded Severely Disabled 



YES 



NO 



S.D. Criteria met (e.g. A4 & B2A) 
Age at Referral sex 



Education 



Reviewer: 



Progress Notes 

*1. If case is in active status, are vocational counseling 
and placement sessions documented adequately? 

2. If indicated as necessary, do documented counseling 
sessions show exploration of vocational alternatives? 

3. Do Progress notes show client-counselor discussion of 
and development of IWRP and any amendments? 

4. How long ago, in months, was last recorded contact 
between counselor and client? 



YES NO NA Comments 



Note: Wherever the terms adequate , substantial , timely, or efficient are present, 
the subjective judgement of the reviewer is indicated. 

* Denotes federal requirements. 



Er|c p-^nic \ 



'-''"I E^igihilitv 

*5. Is an adequate Rcncral medical report, indicating a 
review of all systems present? 

*6. If indicated by circumstances or by the general 

medical, are appropriate specialist's (psychologists, 
psychiatrists, surgeons, etc. ) reports present? 
(Indicate deficiencies) 

*7. Do these reports indicate the presence of a medically 
recognized disability? 

*8. Does medical information indicate the condition to be 
stable or slowly progressive? 

9. Are functional limitations, as they relate to employ^ 
ment, adequately described by the counselor? 

10. Is SD or Non-SD properly coded? 

11. Are primary and secondary disabilities properly coded? 

*12. If in status 10 or above, has the counselor indicated 
a rationale for eligibility using the two criteria? 
(i.e. substantial handicap to employment and reason- 
able expectation) 



YKS NO NA Comments 



*13. 



Is a proper certificate (s ) of eligibility present? 



Economic Need 



14. If any service indicated requires consideration of 
economic need, was an adequate determination completed? 

15. Has economic need been reviewed as needed? 

Extended Evaluation 

*16. If 06 was (is being) used, are reviews recorded as 
necessary? 

17. Was (is) any evaluation provided during time in 06? 

♦18. Was extended evaluation terminated after a period 
not longer than 18 months? 

IWRP 

19. Vocational Objective /Code 

20. -Is anticipated date of employment given? 

21.. Has the counselor adequately shown how this vocation 
was selected nnd why it is appropriate? 
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22. At the time of IWRP-3 development, does the case 

information indieate the elient could have aehicvcd 
reasonable satisfactory pcer-levei employment without 
the aid of V.R. services? 

*23. Are steps toward goal clo.'irly identified in terms of 
client's functional 1 

24. Are services to be proviu-u i);,. bus clearly identified? 

*25. Are measures of progress with time frames relating to 
the steps clearly stated in terms of observable 
performance? 

*26. Is the client's financial responsibility and use of 
similar benefits clearly shown? 

*27. Are the client's other responsibilities in the 
execution of the program clearly shown? 

28. Has placement been planned as an integral part of 
the IWRP? (See CSM, Section H ira?-3{5)) 

*29. Does the BvTlP include client views toward program? 

30. Are follow-up services clearly planned as part of the 
program? 

*31. If IWRP-3 is over one year old, are results of an 
annual review present? 

Homemaker 

32. Does" information on Honiemaker's Activi ty Chart agree 
with stated funct^' n:>"' l.imirations? 

33. If client living alone is being served as a homemaker, 
does case record show clearly that he/she is being 
prepared to function in homemaking duties rather than 
self-care only? 

34. If the individual's vocational objective was changed to 
homemaker during the rehabilitation process, does the 
case record show that substantial rehabilitation services 
were provided and that these services contributed 
significantly to the client's vocational adjustment 

as a homemaker? 

35. Did the case lecc J s^-^^.v evidence of a personal contact 
to verify the client's performance as a homemaker? 
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36. ir used for plan amc/idmcnl, docs the IWRP~/1 itielude a 
summary of services to date and an indication as to 
client progress? 

37. If used for plan amendment, docs tlie narrative indicate 
what ^..'.ent is to vcc<-'' , from he/she is to 
receive it, and why he/she is to r-^ civc ^l. 

38. If employment objective is being changed, does amendment 
narrative state specifically why this vocational goal 

is more suitable and how this was determined? 



SSDI-SSI Documentation and Verification 

*39. If client is receiving SSDI and/or SSI benefits, has 
verification been requested and/or received? 

*40. Has the BRS-31 been properly completed by counselor 
and signed by District Manager? 

41. If yes to both above, has client been placed on Trust 
Fund or SSI funding (proper budget)? 

42. If client has been evaluated with SSDI-SSI funds on the 
basis of **strong likelihood", does the case file contain 
one of the necessary documents showing an allowance 
that is dated within the past 6 months? 

*43. If at any time prior to closure client no longer meets 
selection criteria, was he/she terminated from funding? 

BRS-11 

44. If client has been in a facility, was BRS-11 executed 
placing client in and removing^ him/her from facility? 

EP-8 

45. Are EP-8s properly completed? 

Job Development and Placement 

46. Does case record show significant counselor involvement 
in job development? 

47. Does case record show adequate counselor follow-up 
after placement? 

IntcrruptcHl Sc*rvi ce 

If case is (has been) in status 124 , was case reviewed 
every 90 days? 

77 
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49. Docs closure itumtery, IWIU*-4, include all required and 
necessary information? 

. Was vocational Ruidance nnd counseling provided as 
essentia, v . .. . 

51. Does vocation at closure agree with i.cest objective? 

52. Were services provided by this agency related to client 
obtaining job indicated on the BRS-300? 

■53. Was client suitably employed at least 60 days prior to 
closure? (Must include basis for determination of 
suitability) 

54. If necessary were services provided in status 32? 

'55. If closed due to lack of disability, handicap or 

potential, are these reasons for ineligibility explained 
in writing to the client? 

'56. If closed non-rehabilitated, is evidence present of 
consultation with the client, parent or authorized 
representative? 

57. If SSDI-SSI funded case which has been closed 26, was 
client's income at least current SGA at closure? 

58. If closed as ineligible, was the client notified of the 
right to appeal? 

General 

59. Are all documents properly completed, dated and signed/ 
countersigned? (indicate deficiency). 



Summary and Comments 



Commonwealth of Kentucky 
Bureau for the Blind 

State Office Building Annex 
Frankfort, Kentucky 40601 



502-564-4754 



Charles IV. McDowell 
Executive Director 



April 10, 1981 



Dr. Susan Stoddard 
Project Director 
Berkelrv Planning Associates 
3200 L .'line Street 
Berkeley, California 94703 

Dear Dr. Stoddard: 

We are very happy to contribute to your work in the refinement of 
VR standards. However, you will probably find that our current approach 
to "case flagging" and "quality assurance" represents a significant 
departure from more traditional VR systems. 

We were previously so impressed by Berkeley Planning Associates 
recommendations on the General Standards that we used it to develop a 
QC model for our own management use. Our Management Information System, 
modeled after the Kentucky Bureau of Rehabilitation Se'rvices and the Oregon 
General Agency System proved valuable in flagging "months in status" ^ 
problems and probable incident of exceptional expenditures . Quite simply, 
we ran a quarterly profile on all counselors and used comparative analysis 
to go from there to identify significant problems. Management by Exception, 
call it if- you Willi However, as sophisticated as our system^ was, we 
experienced little improvement in our essential work. As you know, the 
heart of the VR contribution is the mutual counselor-client development of 
a substantial and individualized regime (I.W.R.P.), based to overcome 
behavioral limitations exposed in diagnostic studies (eligibility), leading 
to suitable employment. Our MIS and our QC approach simply could tell us 
little about these most important areas. It is very possible, we have found, 
to ring off smoothly without flaggs and QC exceptions and still hcve inaccurate 
eligibility, inappropriate I.W.R.P., and unsuitable placement. You can even 
have a 95% client satisfaction rate with poor counseling as long as you grind 
out the services in a timely manner. 

So, after some rather long soul-searching we have junked the General 
Standards system and our MIS printouts for standards developed in the 
"Georgia Management Control Project". Since you probably know about this 
system, developed by James Ledbetter (SD Georgia), we need not tell you more. 
Anyway our turn around has been remarkable. By stressing these standards, 
monitored by case review, and by putting professional expectations of 'Higibility 
I.W.R.P. - Placement up front of status control, acceptance rate, etc., we are 
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Dr. Susan Stoddard 
Page Two 
April 10, 1981 



beginning to see real outcome improvement. We have run the Georgia Control 
as a test in FY 1980, and the most notable improvement has been increased 
professionalism among staff and a better qual ity of worklife. Oh yes, our 
former problems uf status control, acceptance rates, and audit exception 
have become insignificant. 

For our state-operated rehabilitation facilities we have implemented 
the CARS system, but we have simulated GMCP standards for rehabilitation 
teaching staff. 

I hope that this information will be useful to you. 



Sincerely, 




Charles W. McDowell 
Executive Director 
Bureau for the Blind 



CWMcD/ER/paa 



attachments 
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REHABILITATION COUNSELOR PERFOR.'-'ANCE STANDARDS 

30.1 GENERAL INFORMATION 

The performance standards for Rehabilitation Counselors with 
the Bureau "or the Blind are based upon the successful practices 
of the rehabilitation counseling profession: 

accuracy in eligibility-ineligibility determination. 

appropriate and substantial services provided to handi- 
capped clients. 

appropriate utilization of case servicr. funds and similar 
benefits. 

successful placement of individuals into employment. 

Five specific standards have been identified as minimum require- 
ments expected in counseling practice. 

30.2 STANDARD NUMBER 1 - ELIGIBILITY DETERMINATION 

Objective: To maximize the accuracy of eligibility determination. 
Criteria for Assessment of Standard 

A. Presence of medical documentation of primary 

and secondary disabilities. Yes/No 30% 

B. Presence of description of how disability 
constitutes vocational handicap. State physical 
and/or psychological limitations in behavioral 

Yes/No 35% 

C. Presence of specific rationale for reasonable 
expectation for substantial gainful activity 
(Documentation of work history, demonstrated 
work habits, transferability of skills, stability 
of previous employment, effects of secondary 
disabilities, client expectations, medical 

prognosis). - Yes/No 35% 

95% accuracy needed for meeting the minimum requirements 
for this standard. 



30.3 STANDARD NUMBER 2 - INELIGIBILITY DETERMINATION 

Objective; To maximize the accuracy of ineligibility determination. 
Criteria for Assessment of Standard 

A. Documentation and rationale as to why one or more 
of eligibility criteria are not met, including 
annual review if closed "handicap too severe." Yes/No 90% 



B. Documentation of client notification of right 
of appeal, including notification to referral 
source. 

95% accuracy needed for meeting the minimum requirements 
for this standard. 



Yes/No 10% 



30.4 STANDARD NUMBER 3 - IWRP DEVELOPMENT 

Objective: To maximize appropriate and substantial services 
provided handicapped clients. 

Criteria for Assessment of Standard 

A. There will be documentation for the stated 

vocational goal of client (i.e., consideration 
of past work history, assets, liabilities, 

transferable skills, stability and motivation, 
medical prognosis, result of any evaluation, 
aptness of goal as related to community job 

resources, etc.). Yes/No 20% 

B. The objectives and services described in the 
original plan will be consistent with the 
functional limitations described in eligibility 
determination. Yes/No 20% 

C. There will be time frames established in the 
original plan for specific objectives and for 

the total goal . ' Yes/No 20% 

D. There will be evidence of client involvement 

in the IWRP formulation and execution. Yes/No 20% 

E. The methods for measurement (evaluation criteria) 

will be described in observable terms. Yes/No 20% 

85% accuracy needed for meeting the minimum requirements 
for this standard. 

30.5 STANDARD NUMBER 4 - FINANCIAL ACCOUNTABILITY. 

Objective: To maximize the appropriate utilization of case 
service funds. 
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Criteria for Assessment of Stan dard 

A. Provision of services consistent with agency policy 
and fees. 

B. Documentation of expenditure of appropriate funds. 

95!^ accuracy needed for meeting the minimum requirements for 
this standard. 



30.6 STANDARD NUMBER 5 - OUTCOME MEASUREMENT 

Objective: To measure counselor performance based on client 
outcome. 

Criteria for Assessment of Standard 

A. The distribution of status 26 closures shall reflect 
the overall mission and objectives of the Bureau for 
the Blind: 

* 70% of all" status 26 closures shall be competitively 
employed (competitive labor market, small business 
or Business Enterprises Program), above SGA income 
level . 

* 15% of all status 26 closures shall be competitively 
employed, above SGA income level, from SSI, SSDI , or 
workman's Compensation. 

* 60% of all status 26 closures shall be Severely Disabled. 

B. Outcome of status 26 closures shall be measured by weighted 



* Competitively employed, SGA from SSI, SSDI, W.C. 

Value 18 

* Competitively employed, SGA, non SSI, SSDI, or W.C. 

Value _7 

* Non-competitively employed, non SGA, Homemaker, 
Sheltered Employment, Unpaid Family Worker. 

Value _3_ 

C. Outcome performance shall be measured according to goal • 
achievement and may be met either by case count or outcome 
measure. 



Yes/No 50: 
Yes/No 50: 
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* EXAMPLE: Counselor X and Supervisor Y agree on the following 
standards of outcome performance: 



GOAL PERFORMANCE 
Performance in total closures by agreement. 



26 Closure 



Case Count- 



Value Each 



Outcome Measure 



SSI/SSDI, W.C. 
Competitive Employment 
Non-Comp. Employment 

TOTALS 



3 
11 

6 

20 



18 
7 
3 



54 
77 
18 

149 



Performance shall be/either by case count or outcome measure. 

Counselor X may achieve performance goal by either reaching case count , 
20 closures as indicated, or any combination of closure values that 
would reach an outcome measurement of 149 points. 

30.7 INDEPENDENT STATUS 

Counselors v/ho meet minimum requirements for standards shall function 
with only minimal supervision. 



30.8 SYSTEM OF REWARDS 



Rehabilitation Counselors shall be appropriately rewarded for 
performance: 



* Promotion: 



As a condition of promotion to Principal Counselor 
all of the minimum standards of performance must 
be met. 



* Inadequate 
Performance: 



* Rev/ards: 



Provision will be made for correcting inadequate 
performance, and counselors whose inadequate 
performance cannot be corrected shall be separated. 
An uncorrectable, inadequate performance is defined 
as an inability to meet all of the minimum standards 
for a period of two years. 

Merit salary increases shall be provided on the basis 
of counselor performance in meeting all of the minimum 
standards of performance and the realization of out- 
standing performance in outcome measures in Standard ir 5. 



COUNSELOR REVIEW 



Counselor performance according to standards shall be determined 
through an annual review of cases provided a review team selected 
by the Director of Client Services. Counselors shall be provided 
with written statements for each case reviewed and shall be given 
the opportunity to defend their work before any review becomes 



Counselor Review Guidelines are included at the end of this secti 




MICHAEL R. PETIT 
COMMISSIONER 



STATE OF MAINE 
DEPARTMENT OF HUMAN SERVICES 
AUGUSTA, MAINE 04333 



ADDRESS REPLY TO: 

32 Winthrop Street 
Augusta, Maine 04330 
207-289-2266 



May 11, 1981 



Susan Stoddard 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

This is an answer to your letter about caseload monitoring systems. Attached 
are several numbered documents. 

Case Flagging 

Attachment SI is a page from a counselor's Case List — a computerized .maste- 
list. (Check It and you will see it is full of information, including a tine- 
in-status history.) We use the counselor's Case List to flag cases of undue 
delay. Every 3 months our evaluation unit screens all caseloads for cases 
that have been in the same status much longer than normal. The result is 
given to my office. We give it to the two statewide program directors 
(General VR and Eye Care VR) and tell them to find out for each case: 

1) Why the client has been in the same status so^long; 

2) What are we doing for the client - currently; and 

3) How long before the client's case can be moved along. 

Statistical Monitoring 

We have a program monitoring process that operates monthly and is based on 
two reports, check attachments #2 and #3. In this process, each line VR 
administrative level is treated as a single caseload, the person responsible 
for the caseload is treated as the caseload manager. (In other words, just 
as the 1st line supervisor treats the counselor.) Thus our statewide program 
directors are responsible for accomplishing the objectives set for their pro- 
gram. I.e., their caseloads. Attachment #2 is reported at all caseload levels: 
statewide, regional and supervisor unit; Attachment #3 also reports on coun- 
selor caseloads. What we do when we monitor the program directors, they are 
supposed to do with the regional directors, and they with their supervisors. 
(Note: the Regional Director is a second-line supervisor, so we have 3 levels 
of line VR supervision below my office.) 

Asterisks in Attachment #2 and plus and minus signs in Attachment S3 are 
supposed to initiate a corrective action plan which the caseload manager's 
supervisor approves and which then becomes the basis of the supervisor's 



ERIC 



May 11, 1981 



Susan Stoddard 

Berkeley Planning Associates 



monitoring of the caseload manager. Attachments #2 and #3 are then used 
to measure the effectiveness of the corrective action plan. This is 
supposed to happen at all levels. 

The "performance limit" in Attachjnent #2 is set as follows: At the 
3-month point (3 months into the fiscal year) , the caseload manager should 
make at least 60% of what was expected by that time, which is usually 1/4 
of the year's total goal. At the 6-month point, it's 80%, at the 9-month 
point ~ 100%. Thus 3/4 of the way through this year, we expect our case- 
loads to be on track, performing at the level we expected they'd be by that 
time. The rationale for this "shrinking" acceptable performance region is 
simple: the closer we get to the end of the year, the closer we need to be 
to where we expected to be (and vice versa), because as time goes on we 
have less and less time to make up deficits. This approach is realistic, 
and we hope it keeps the false alarm rate down. 

Casework (Quality) Monitoring 

Attachment #4 describes our Quality Control Process (QC) . Since it was 
designed, we've converted to quarterly sampling and reporting and to an 
evaluation instead of a monitoring process; i.e., we try to find out what 
the causes are of casework problems the case reviews uncover, rather than 
simply identify the problem and leave it at that. The QC process is 
operated by our evaluation unit and reports to my office. This process 
focuses only on the two statewide programs*, treating each as a caseload 
and the program director as the caseload manager responsible and account- 
able for the quality of the casework sampled. * (We do\'V t havz tliz 6ta{^{^ 
io appltj tiiz QC p^ocu6 bo^oio tixt ^tcutmlda cxu>QJioacU. Tlia^ QC p/L0ce64 
can tnlQQQA additional co^c ^nvlmi^, aimed at getting mo^o. to^tkz bottom 
oi pAobZmi^ uncovQAzd at tliz ^tatoivld^ lavoZ, lolUch coatd bz dono. btj Ut 
tint ^upcjivi^ou o/i by AzhabUAXation con^uLtaivts out 0|J ouA Stata dzntxal 
OiJ^^ce. ) The other change we've made to the QC process design is to make 
this process look for causes of problems indicated by the Statistical 
Monitoring process. Thus the "quality" and "quantity" monitoring processes 
are linked. 

If you have any questions about these reports and systems, contact my 
Deputy, Tom Longfellow. You can also contact Doug Cowie or Linda Wilcox 
of our Program Evaluation Office, 59 Court Street, Augusta, ME 04330. 
Their phone nmber is 207-623-8461. 



Sincerely, 

Owen Pollard 
Director 

Bureau of Rehabilitation 



/11m 

cc: T. Longellow 
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L APPENDIX "A" 



PM DIVISION OF VOCATIONAL REHm MH 
QUEITY ASSUimiCE IN CASELOAD MNAMT^ 



• 15-15 



filOGRESS THROUGH VR 
PROCESS IN ORDERLY 
AND HHELI FASHION 



1. Referral 



2, Applicant.., 



3. Extended Evalu- 

atlon 
li. Acceptance 



Appointments and Infonnation 
giving 



Orientation and diagnostic 
work-up 



DECISIONS AND ACTIONS 
MADE IN THE NAME OF 
STATE AGENCI ARE PROPER 



STATUS 



Additional diagnostic services 



Client notification of accept- 
ance and assessment of evalu- 
ation data 

Develop plan with client 



Eligibility or ineligi 
bllity 




Services Inter- I Counselor contacts 
rupted 



10. Case Closure 



Advising of closure and 
contlJiued availability of 
services 



11. Post-aiployment Heetijig additional needs of 

cUent 
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ASSESS^ CRITERIA (GUIDELINES 



Probability of 
Success "26" "33" 



Reinitiate services or 
"28" 



Completion of closure 
forms and review of case 
by counselor & supervisor 



Verification of services 
and Closure "33" 



2li 



26 



32 



Probability of 
Non-Success . 
"08" "28" "30" 




6 
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I APPEflDIX "E 



15-17 



HARVLAND DIVISION OF VQCATIQf lAI. REHABILITATION 

"my CASELOAD anKis ~ 



COUNSELOR: 



SUPERVISOR: 
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The Referral Rate 1s established by addiny the total referrals 
recorded on the STATMO 04/06 within a ijiven time-period and dividing 
that number by the total months. 



TO TAL REFERRALS TO OATE 
NUMBER OF MONTHS 



_ The Referral Backlog is established by adding the cases curre ntly 
^" 00/^<^ and dividing the total by the average number of decisions 
per month. 

"Average number of decisions per month" is established by addiny 
the number of cases accepted to date and the number of cases rejected 
"08") and dividing that total by the number of months. 
STATMO 04/06 is used to provide this data. 

CASES (•■:; HANO ("00"+"02.' 



. CASES (•■:; HANO ("00"+"0 2" ) 

ACCEPTED TO uATE + REJhCIEU 10 uATE "(08)" 



NUMBER OF MONTHS 



The Acceptance Rate is established by adding the number of 
clients accepted for services and dividing that number by the sum of 
the number of clients accepted and the number of clients reiected 
(status "08"). 



NUMBER OF CLIENTS ACCEPTED 



NUMBER OF CLIENTS ACCEPTED + CLIENTS REJECTED 'W^ 



The Rehabilitation Rate is established by adding the total number 

of cases closed rehabilitated (status "26") and dividing that number 

by the sum of the total cases rehabilitated ("26") and total cases not 
rehabilitated (status "2d" and "30"). 



CASES CLOSED REHABILITATED ("26") 



CASES REHABILITATED (26) + CASES NOT REHABILITATED ("28-30'") 



92 



1. Thcjca ctcadarda iiza cffQctive April 1> 1!?7S, 

2. Th2 information cystam uoad to ccr.rltor clients' ui\:e-ia-.;tQCuo v?.li 
bagiu with tho report of data rG-ordud in a coua:ia tor's AhtII w^Lote.r .11 at. 
This data should be cc^iplled at tho sat-^a tin-.:* as the couaseTor .caupuLos uha 
Monthly Cnssload Report lovsheet'*) . 

3. The* fcrnat for reporting the uis:.bar of clienti; cy;cet<liv.g th^ ti-e- 
in-Gtatuo standard vlll iucluda: ' • * - 

a. By status, a list of the naxes of cllcntc who exceed tb3 
tic:c-in-statu3 atar*dard, the data cn vhich o&ch entered that atatuu^ * 
and the total nur-bcr of clients; thio Infortsation will bo ccrcpilcd 
monthly, by every counselor, and a copy, of the liat will given 

to the Unit Supeiwlsor; 

b. Cn a mcnthly basis, tho Unit Supervisor vill prepare a renort 
for the Area Suparvisor that will include tha nusbcr of clients Vaud 
the tica over standard, by each ctatus, for hio/hsr total unit; ex: 

Statug 00 4-l i2onth over* 

5-3 taonChfl over 
1-6 montha &vf?r 

Also include the change in the nvzrber of caaes and length of tim " 
over standard for the previous coath; 

c. On a quarterly baaie, the Area Supcrx'iacr vill ccii::pilQ th^ 
dat3, ao dencribed in (b) , for the total Arcis Office, in all s^tatur^oc, 
and forward cuch totala to tha Ucjional Director. The first repovt 
will be duo to the Re£;lcniil Director by Av-ril 30, and vlll reflect 
izta froa the April g?.5ter liJt o nly. This re].*ort vill be utilised 

an bareline data to cvaluata subsequent prosren;-;^ The nest report 
will be dun to the r.egicnal Director by the last day of July, axxd 
will reflect data frcw the July xyster list c»nly, Sitbsequant reports 
vill be due every three cionthn (end or October, Janusry, April!; an^ vUl 
reflect data frcn that n:cnth*s liastcr list; 

d. On a quarterly basis, the Resicn.'il Director will ref.'ort avich 
data, for the Ragioa, in all stctusea, to Lhe Tiractor of Fl^^ld 0-;er- 
atlcns, consistent with the schedule, as dco':ribo.d in (c> ^bovo, 

4. The infcrnation concerning tha leni^th of CiiL:^ that a cXLf?:nt io r.?.- 
corded in any status is to be used by the Vnit Supervinof as on-a techiiiijuo 
to revieu caseload tranacerant in his/her unit, and to dc-tcraiiua trhich cziocz, 
nuirlt a care specific ravlev. Identifyins client.i who rer:^;lu in status 
over tha standard time will help to identify those barriers that prevent tbe 
tinely provision of services to tho^e clients. Once idaatifled, action can 
be taken to rcccvo those barriers. 
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TII'lE-IN-STATUS STWIDARDS REPORT 

_ OFFICE for period ending , 197__ 



TOTAL CASES 
IN STATUS 



CASES HEETIJIG 
STANDARD 




CASES . 
EXCEEDING 
STmNDARD (F) 



NUl^BER OF CASES, 
EXCEEDING STANDARD 
BY: 



9J 
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STATE OF MICHIGAN 



PHILLIP E, RUNkEL 
Superintendent of 
Public Instruction. 



May 18, 1981 



DEPARTMENT OF EDUCATION 

BUREAU OF REHABILITATION 

Box 30010, Lansing, Michigan 48909 



STATE BOARD OF EDUCATION 

liAKHAHA HOMRHTS MASON 
President * 
NORMAN OTTO STOCKMHYBR, SR 
' ' Vice President 

DR. CUMrCINDO SALAS 
Secretary 

UARHARA nUMOUCHELLR 
Treasurer 
JOHN WATANF.N. JR. 
^ NASnE Delegate 
SILVERENIA Q. KANOYTON 

ANNETTA MILLER 
DR. ED.MUND F. VANDETTE 
Governor 
WILLIAM G. MILLIKEN 
Ex-Officio 



Ms. Susan Stoddard ^ * 

Berkeley Planning Associates - ' " 

3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

In response to your request for information regarding Michigan' s qual i ty 
assurance and case flagging (for undue delay) systems, we have attached 
the following: 



1 



2. 



Information and samples of our case aging study (Z2110) which is 
our primary tool in monitoring time in status. This print out 
is prepared monthly and compiled at the counselor, district, area 
and state level. It is one of our more significant management 
tools at all levels. 

Materials regarding the new Michigan Quality Assurance Review 
System (Q.A.R.S.) whicn, it is intended, will be the agency's basic 
review. document for assuring federal compliance as well as. com- 
pliance to Michigan's policy and procedures. The material includes ' 
an overview and implementation schedule, a draft of some information 
to be used in the installation process and a copy of the case 
review document itself. This latter includes the soace for recording 
responses as well as the criteria which the reviewer will be using 
in determining the responses. While the review document as you see 
it will be completed for each case review and tabulated . by hand; it 
it planned that, with full implementation, we will be using a data 
processing input document instead to record the responses. J have 
- • enclosed copies of a couple of different formats which we are 

looking at currently. While the implementation procedures and time 
frame may change, the review document and criteria are fairly firm. 

I hope you will find these materials helpful for your project. If you have 
any questions about them or I can provide any further assistance, please 
feel free to contact me again. . 



Sincerely, 




peter- p. Griswold, State Director 
Michigan Rehabilitation Services 
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NARRATIVE DESC?.I?TIO^] 



VTI. . CASE AGING STUDY 
V Z211C 



The purpose of 
of all cases, 
casev/ork proce 
ca tegor ies . The 
each month as 
delayed as the 
The pi' intout i 
1 ist ing of all 
two- page suTrcna 



r he Case Ag ing Study is^to provide an inventory 
to highlight cases that maVvbe delayed in the 
ss and to summarize caseloadsxby target 

Aging Study is printed as near to the 15 th of 
possible. At the end of each quarter it may ba 

purge of closed cases is also done on the 15th. 
^ arranged in two major sections.. First is a 

cases by counselor and status followed by. a 

y sheet of each caseload, district/ and' ar.ea. 



LISTING OF ALL 



All. cases that are open and .have not been purged are sorted 
first by the district office to which they are Assigned. 
Within each district, cases are sorted by the counselor ' code 
assigned to the:?: and within this grouping , they are sorted'bv* 

cases are arranged by time., in status^so 
a particular status will be listed 
group there' is a blank line to seoarate 



ct=**:tic. ;.'vithin status, 
that the oicesz^ case in 
first. For each status 



cases Tinat are overage fro.-;; cases thcTt are not over aged. The 
cuicc-lihes for cveraged case'^i are found" in Casework Manual It^m 
303.21 and are: - 



STATUS- 



00*-3 
02- 3 
06-18 
10- 
12- 
14- 
15- 
20- 
22- 
24- 



MONT 



Each case is iisred snov/ing nanie, subprogram" code , social' 
security r.un^.ber , and case numoer . The following colu:?.ns are 
'cseu to indicate other data for each spec if ic client . 

(1) SPEC CHA?v - Tne special, character istics sum can be 
interpreted as follcv/s: 
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Q.A.R.S. 



This document is intended as a job aid in reviewing casework. It is 
sential that cross references to the manual^be used. 

!• Does the intake include . • . 

a. an accurately completed RA-2910 (Intake Form)? 

Yes No 



['Each- item on the intake form must be completed. Names and 
phone nuzibers of. two interested persons are reauired, Kowe 
counselor could document ^'client has no other contacts 

3250, 3350] 

b. an accurately completed RA-2911 (Intake Record)? 

Yes No 



[Each item on the intake record must be completed. There must 
be a source of support recorded. 

3275, 3360] 

r, 

c. an accurately conpleted RA-2909 (Client Rights & Responsi- 
bilieies)? 

Yes 'No 



[The form must include a parent's or guardian ' s signature for 
clients under age 18 or who are unable to understand the form- 
Refusal to' sign must be documented. All cases must include a 
completed RA~2909." ~ . 

3330] 

d. an accurately completed RA--300--1 (Ref erral Record) ? 

■I 

Yes __ No ^ 

[All items must be completed. Data are used for reporting to 
the- federal government , for managed intake" and order of selec- 
tion. Therefore, accuracy is essential. 

3325, 3330, 3AOO-3A70, 3675, 9860] 



e. an accurately completed RA^2908 (Diagnostic Plan)? 

Yes " No 

[The "next step" of a diagnostic plan must describe specific 
activity(ies) and date(s) and time(s) in all cases. The "next 
"step" should be in a language' that is clear to the client. 
Example: "I'm here on Fridays - call me on Deceniber 19 before 
3:00 P.M. and we will talk about the results of your medical 
exam." 

A separate form should be completed when services/exams are 
arranged after the^ initial interview. The new form must contain 
an updated "next step'." For all diagnostic plans, the date of 
the fern must be on or before the date, of any planned services. 

■ 4025, 4030] 
Contain a current general medical or equivalent? 

Yes No 



[General medicals must meet the criteria outlined in the manual. 
All "equivalent" general medicals must be approved by the medical 
consultant . 

4225, 4300] 

Contain a current psychological or psychiatric exam? 

^'es ^ No . N.A. 



[Psychological testing to establish a disability of M.R. can be up 
to three years old. The test must give .a full scale I.Q. score from 
a standardized, individually administered test done by a licensed 
psychologist. 

Psychological and/or psychiatric reports must give a diagnosis, 
using DSM nomenclature and can be up to one year old, if the con- 
dition is stable* 

Check N/A response only if the case is other than M.R. or M.I. 



4225, 4425, 4500, 5200, 5210, 5230] 
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Contain sufficient data to establish that the client has a physical 
or mental disability? • / 

Yes No : ^ 

[If additional exams were recommended/ were they obtained, or ruled 
out with appropriate documentation?,] - - . 

DISABILITY EXAMINATION REQUIRED 

^^'^ . treating physician, orthopedic', 

physiatric, or neurological exam 
5100 



Cardiac 



treating physician, cardiologist, 
or internist - 5130 



Dental dental exam - 5150 

Diabetes treating physician or internist 

5160 

Hearing - otologist and audiologist - 5180.. 

^^•R- I. qT' score - 5210 

Obesity reference 5220--5221. 

Psychiatric Psychological/Psychiatric - 5230 

Substance Abuse medical report, psychological, or 

psychiatric report - 5260 

Visual Impairment ' optometric, ophthalaological - 

5270 

Please reference Section V of the casework manual for additional 
disabilities. 

5. Contain documentation of medical consultation and follow-up where 
required? 

Yes No N/A 

[All questions asked by the counselor to the medical consultant 
should have answers documented on the RA-2913 (Client Study). 

There must be evidence of follow-up on medical consultant's recom- 
mendations or a documented reason why they were not followed. 

Use N/A response only wher^i consultation is not required. 

A800, A825, 4830J 
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Contain sufficient data to establish that the client has a substan- 
tial handicap, to employment? 

Yes No 

[Therc^. must be specific documentation: mbdical reports of limita- 
tions, workshop reports, or 29 entries documenting counselor obser- 
vation, and/or narrative documentation oi handicap to employment on 
the RA-2914 (Eligibility Statement)* 

5000, 5 300-5 310 J 

Contain data 'to document that the client has potential for employ- 
ment? 

Yes N/A 



[There must be specific documentation: medical reports of limita- 
tions, workshop reports, or 29 entries documenting counselor obser- 
vation, and/or narrative documentation on the RA-2914 (Eligibility 
Statement) • 

• 5000 

If answer is "no," the case should have been placed in status 06 or 
closed 03. 

Check N/A if the case has been advanced 05 or if case is still in 
02.] 

Contain a properly completed certificate of extended evaluation? 

Yes No N/A 



[Check N/A if case has not been in 06. Check "no" if the case 
is/has been in 06, but the certificate has not been properly com- 
pleted. 

The rationale section on the RA-2914 (Eligibility Statement) must 
outline specific ques*-.ions regarding feasibility. Example: "We 
need to determine whether Mr. Doe can extend his physical tolerance 
beyond four hours per day. We also need to determine whether he ca: 
work out a reliable plan for morning attendant care.** 

4850, 4871, 4855] 

a. an accurately completed RA-300-2? 

Yes ^ No 

[All items must be complete and accurate. 
5400-5425] 



Contain a properly completed IWRP for extended evaluation? 

•Yes No N/A 

[Check N/A if the case has not been in 06. 
All sections of the IWRP must be complete. 

There must be a client signature or documentation that the plan has 
buen reviewed with and approved by the client. The client receives 
a copy. 

There must be a clear relationship between the feasibility questions 
documented on the RA-291A (Eligibility Statement) and services 
planned in the IWR?. 

4850-4871] 

Contain an RA-2914 (Eligibility Statement) which: 

a. docuz:ents the disability (ies ) 

Yes No 

[If there are multiple disabilities, each disability and the 
resulting limitations must be documented on the form. * 

, The following disabilities must be accompanied by quantifying 
data: 

M.R. - I.Q. Score 5210 
Visual - visual acuity with correction^ 5270 
Hearing - decibel loss unaided 518o' 
Cardiac - American Heart Association Rating 5130 
^ Cancer - Karnofsky Rating & Stage 5120 
Obesity - Height & Weight 5220 

For clients with M.R., I.Q. 's in the range of 70-85 and under 40 
must include documentation of behavioral factors. 

5210 

Psychiatric disabilities must include documentation of .status in 
therapy (or waiver) including type and frequency of therapy. 

5230 

Documentation of epilepsy must include seizure type, medication 
and date of last seizure. 

5173 

Documentation of diabetes must include type of diabetes and med- 
ication . 

. 5160] 

lU2 
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b- documents the severity 

. Yes No N/A ^ 

[Severity codes 4 and 5 must include documentar.ion of qualifying 
factors. Coding must be supporter', by documentation of obser- 
vation or third party reports. Codes 3 and. 4 must be coapatible 
with disability codes on the RA-300-2. 

3470 

Check N/A for cases accepted prior to .] 

c. docunents the vocafiior.al handicap 

Yes No ■ 

[Docun:entation must be consistent with case file data or coun- 
selor narrative. 

5000] 

/ 

d. documents feasibility 

Yes No 



[Docu.'nencation ir.ust be consistent with case file data or coun- 



sclor narrative 
5000]^^ 
c. is properly signed 

Yes No 



[Must be signed and dated by counselor. (In sonie offices, there 
niay be a local requirement for a supervisory signature.) 

5300] - 

is acco:?.panied by a properly completed Rx\-300-2? 

Yes Iso ^ N/A 

[Check N7A if RA-300-2 was completed at 06. All items of 
RA-300-2 must be complete and accurate. 

If diagnostic process has 'resulted in new information regarding 
disability or severity, these items must be updated. 

5400-5425] 
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11. Contain a Plan Davelop:zent Narrative? 

Yes ' No yjA 



[A Plan Development Narrative musn be written when a case does not 
move simultaneously into status 10 and 12. 

Check N/A if case* moved simultaneously into 10 and 12. Check "no" 
if a required plan development narrative was not written and if the 
plan devel/opiTient narrative is not coniplete. 

5325] 

If yes, . . . 

a* does it include a properly docuizented "rationale?** 
Yes No 

[The rationale nust ouLline specific questions which must be 
answered before the I'.CRP can be developed. Example: "We 
need to determine whether you will be able to complete the 
two-year college program or whether che shorter certificate 
course could better meet your needs." 

3325] , . ' 

b. does it incUide proper documentation of services, costs, 
time frames and planned foilow-up? 

Yes ; No 

[Services muse be consistent with questions outlined in the 
. rationale; dates, tizies, costs and provider(5) must be spec- 
ified. 

The method and schedule for reviewing client progress must 
be specified. 

5325] 

c. does the case record show. that the client received a copy of 
the Plan Developnient Narrative? 

Yes No 

[5325] 
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d. were planned services properly provided during the Plan 
Developr.enu process? 



Yes 



AO 



(Before the case enters status 12, the counselor must docu- 
nent that the questions out2 ined in the rationale have been 
resolved. If planned services were not provided , "there must 
be a reason given.] 



Describe and appraise the following: 
n% personal and social adjustment 



b. medical factors 



vocational ad justraen t/capaci ry for 
J*: 



successful job Dcr f or.T.ance 



educational' a chie venent 3 



e. intelligence 



f. ability to acquire occupational skills 



g.^ employr;ent op^por tuni ties 



describe 

appraise 

describe 

apprai GC" 

describe 

appraise 

describe 

appraise 

describe 

appraise 

describe 

appraise 

describe 

appraise 



. yes 
no 

• yes 
no 

• yes 

no 

• yes 
no 

• yes 
no 

• yes 
no 

• yes 

no 

• yes 

no 

• yes 
no 

• yes 

no 

• yes 

no 

• yes 
no 

. yes . 
no 

• yes 
no 
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[Pxeferenca the cEsevork iten on client appraisal. 

Each item nust be described by third party data - reports, etc., 
or by casework ent-i;'ies. 

The client appraisal entries should not repeat descriptive data 
but should sui2Ziarize, analyze and draw conclusions frofo diag- 
nostic daca- E>:ariple: "ability to acquire occupational skills ^ 

- Based on test results, ' has a bet ter-than-average 

abilicy to coinplete the planned training • . • 

Has the client received SSI or SSDI at any tine during the case 
process? 

Yes SSI Yes SSDI Yes Both Neither 

If yes, does the case contain: 

a. a properly completed SSA-I^O?/ S5A-lA0S-^:4 ? (Request for 
Verfication) 

Yes 



[Either the S5A-1407A or uhe SSA-1408-UA cust be submitted 
for all clients knovn to be receiving SSI or SSDI- 

983-, 9S35] 

proper docuzientation of strong likelihood? 

Yes r.o ::/A 

[ Docu-entation of Strong Likelihood- one of the ten docu- 
r.ents (six ironrhs old or less) r:ust be in the case file and 
lie- 0 of the RA-300-1 izust be properly checked. 

If verification or temporary verification was av^ailable in- 
stead, check "21/ A . *' 

9S60] 

proper use of temporary verification? 

Yes-__ No ::/A ^ 

[Check ^7A if terrporary verification was not needed.] 

[If temporary verification was required, the case inust con- 
tain one of the seven aocun^.ents (no r.ore than six months 
old) and a properly co:.-.pleted RA-2944-Z. Temporary verifi- 
cation n",st be processed 30 days after requesting verifi- 
cation (1A07a/1-^03-UA ) unless verif ication w^as received 
before that tir.ie. 



9890, 9S91] . ' 
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ci, is there appropriate documentation to support the use of X 
or V funds? 

Yes No ■ - 

[Check 'V-o" if: - There was no DOSL or verification at time 
of authorization. 

- The client did not ^neet the selection cri- 
teria at status 12 or beyond but X or V funds 
were used. 

- If Che grace period for a terminated case 
hacl'^expired but X or V funds were used. 

- If services not outlined in the IWRP were 
authorized during the grace period using no X 
or V funds . 

9350, 9858, 9895] 

e. Vas an RA-2737 (SSA Eligibility 
status 12? ' 

Yes No 



[Check N/A if the case is not yet in status 12. 

The r;A-2737 must be conipleted at status 12 for all persons 
who Were receiving SSI or SSDI. Check **yes" if the RA-2737 
was completed after status 12 for clients whose benefits 
began later. 

^> / 

9872, 9875-77] ■ ' 

If yes , . . . 

1) was Point 1 properly docur.onued? 
Yes x\o 



[The counselor nust docunent that the .disabling con- 
dition is not so rapidly progressive .or severe as to 
preclude SGA level e:aployi:ient . The diagnosis and prog- 
nosis nust be supported by case file information. 

9827-9877] 
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• Certification) completed at 
N/A 



2)' w.i!-. roliii,. 2 i.ro|HM',ly ilociiin.'iil imI? 



Yc.'i , No 

I'l'lit: (•(HiiKU! 1 oi' must. nn:;wt;i" Uu; (|in.!;il loM ri')',a ril I iiy, iilic 
mod lea I exam diary dnw. •■Iliikiioui." ..ilimil.l l)i./(TT>tij;(..l 
onJy 1.1 c.a.-.t;.-. wluM-o Mio f.a.sc fll,: .loe;: ik,l I i/i: 1 luUntn 
SSA"H:M-u:), S.SA-n;3:i-tj:,. or a vor l ricaLlon (loc.mc;..!, . 

(;l l..;ni.j! with Li;.!i|)nrary til f;nl> I 1 J t. do not; mu.M. crlt;e,rl 

Thu ccnin::i?lor munt: r*' foriMUN,: n iniMllcnl ruporL or :\ 
ra/il unuMU: by Uu: muHllca l^ com.mi 1 1 /uu. Lhal Lho c LI cut I:; 
nor tixpccl.cci lo Improvo i:u'tl 1 i:a I I y . 

3) was Point. 3 proper I y ikuuiuK'nCcul? 

Vi»r. Ko ^ " 

V [Tly! counsolor must, iit.a t>. i hif ;if>x^c;l T 1 1: vocatloiial oh l^c- 
.tlvt!. !iullc:nt.o wIkmIum' S;(;a J s oxpr'CM^rd to rcau 1 t. , anil 
raai-o tlu! r*.ta:;on wliy i;lu: client hi oxpt'ctcd to arialn 
Mil ob.ivct, I vc . 

o 98:!V-9tW7 I " 

A) was Point'/* propt;r,ly clJcvunuMitcclV - ^ , 
*» . 

Vus ^ No ^ 

(The couhiw»lor must nmku a jucI.c.mL'nt nil to wlw Hum' orHo( 
Lho c1UmU-'£; carn.Inc;:; witjl offiicl tho expanses of ■ 
lils/hur rcliahl 1 I la i Ion. 

^ ■ 

9a:r/-ya77] • • 

If SSA has rociocstcd a self-support plan, Is thcM'P (^vlilrncr 
that It was ))rovJdcHl? 

^ Vos ^ No _ V ^/y^ ^ 

(Chock "N/A" If a s(vlf-sup|)ort plan was not roqurstod:, 

Chock "no" If SSA mndo a roqu-st hut tin* covuisolor did not 
rospoMfl. ■ ^ ■ ■ " 

9910, 9916) 
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Does the IWRP docunent . 



a. that the plan was developed with the client, that required sig- 
.natures were obtainecTand that the client received a copy? 



Yes No 



b.- an appropriate vocational objective and rationale? 

Yes _: No 

[Case file data nyst be cons'is tent wi th' v6cational. choice . - 
^-^^'j^-^'i^J^ed in "rationale*' .nust be supported by an or 
RA-2>i^ entry or third party data. 11 there is contradictory ^ 
data, ttte counselor's basis for decision must be documented.]? 

c that intermediate objectives were identified?,' 

Yes No 

d. a full description of required services? 

Yes '_ No 

[Services must be related to achievecent of. the intermediate 
objectives and vocational g'bal;^dates fpr services must be given 
as vv'ell as actual or estimated costs.] 

e. that other financial resources, including those of the client, 
were considere'd? ' . ' 

Yes No - N/A 



[Include here use of financial aid for training /and other money 
contributions (similar benefits). 

7525-7538, 7030] 

a specific plan for evabjation of client progress? 
Yes ' No 

[Method of evaluation, should be specifically described. Evalua- 
tion goals must, be measurable. Example: "You are expected to 
maintain a -"C" average and type AO wnm by the sixth week of the 
class • "] ^ / . *' ' 

that the client had an opportunity to add comments about the 
lUKP? 

Yes ' K'o 



[Check "yes" if the client had an- opportuni-ty to comment but 
elected not to do so.] - ^ 



M-1 
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Questiions 15-22 

KOTE; It is possible that a service was needed but never provided. 

If, for evample, training was needed, you might check "yes" on 
Question vl8 and "no" on Question :.-^13(a).. Use N/A only if the 
Service has not yet begun. 

In reviex^ing these items, consider the original IvniP and any amendments. 

In evaluating services, use the following manual references: 

Manual Item 

0 

Guidance L Counseling (Status 14) 7220 
Physical Restoration \ . 7250-7410 
Meptal Restoration 7425-5230 
V.ocarional Training 7500-7660 
, t-Iaintenance ^ 7800 

Tran£?or:ation 7818-7S24 
Oth&r Goods. 6 Services-'^ 7825-7890 
Probleni Solving Si Counseling 7200 

-Includes teleco— unica tion .aids , equipment related to job modification 
etc. . . • ■ ' 



Following the iniiiacion of the IV.'R? , ... 

15. Was guidance and cou-seiLng (Sta::us 14) a needed service?' 

Yes y.o 



a . 



If yc5, were counseling services appropriately provided/arranged? 
Vcs No :\7a 



16. Was physical restoration a needed service? 

Yes Xo 

a. If yes, was it appropriately provided/arranged? 
■ . Ves Xo :;/A 

17. Was mental restoration a needed service? 

Yes Xo 



a. If yes, was it appropriately proyided/ar ranged? 

• Yes Xo X/A 
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18. VJas vocational training a needed service? 

Yes Xo 

a. If yes, was it appropriately provided/arranged? 

Yes No N/A 

19. Was maintenance a needed service? 

Yes No 

a. If yes, was it appropriately provided/arranged? 

Yes ::o K/A 

20. \^as transportation a needed service? 

Yes No 



a. If yes, was it appropriately provided/arranged? 

Yes No N/A 

21. \/ere OGS needed services? 

Yes No ' . 

a. If yes, was it appropriately provided/arranged? , ^ 

Yes No N/A 

22. was there evidence of proble- solving and/or ongoing counseling? 

Yes No 

23. \/as'an er.ployr.en c plan needed? 

Yes . No 

[Check "no'* for clients who secured their own job, returned to a 
forner job, are being helped ;.o maintain present job, or are en- 
ployed as a ho-er.aker. Also check "no" for clients who are not yet 
ready f or ^placenient . ] 

If yes . . . 

a., was an er.plo>inant plan written? (Consider eithe^ plans v/ritten 
at 12 and/or 20.) 

Yes No 



ill 



24. 



If yes, does it document 
1) cost: services? 

Yes 
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Ko 



N/A 



[Expenditures for placement must include a rationale. If 
tools and equipment are purchased, appropriate bids must be 
in the case file. Check N/A for no cost services needed. 

7800, 7805, 7810, 7818, 7870] 

2) counselor activities? 

Yes No 



[A "yes" response requires that the client be provided with 
one or nore of the following: Job-Seeking Skills, Job Club, 
specific job leads or interviews. "I will call you about 
any jobs that I hear about" is not an acceptable statement 
of counselor activity.] 



3) client activities? 

Yes 



No 



i ihere must be specif inactivities described. For exaiaplc: 
"You arc to keep a job-seeking log and interview at three 
different companies each week."] 



A) activities of other agencies? 

Yes No 



N7A 



(A "yes" requires that specific activities be described.] 

5) i:rr/.etable and plan for follow-up? 

Yes No 

[Ihere must be a plan to follow up and review at least every 
30 days.] 

Has the client been offered a required annual review? 

Yes 



Ko 



N/A 



'[The annual review must first be offered 12 months after case 
enters status 06 or 12 and every 12 months thereafter. Errors 
\vill only be counted for the last two annual review periods, 
ijse .\7A where client is not yet eligible for an annual review-.] 



1-1 
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• If yes . . • . 

a. Was the client provided, an annual review?- 

'\ Yes No N/A 

[Use NVa where the cUent .did not avail her /himself of the serv- 

_ ..-ice Use "no"" where there is documentation that the client 

wanted an annual review, but one^was not completed.] 

If yes • . . . 

1) was it timely? 

Yes No 

[Check "yes" if annual review occurs between the 11th and 
13th month. ] 

.2) was it properly completed? ^ 

Yes , No 

[The 29 entry must document client progress, continued 
agreement with the vocational goal, review of client' rights 
and a next step . ] 

3) did the client receive a copy of the case entry? ^ 
Yes No 

25. V.as a required plan an£ndment(s) written? 

Yes No -N/A 

If yes . . . 

a. has the amendment been properly docur.^ented? 

Yes No 

26. Does the case document ... . * "^^^ 
a. significant client/counselor contact every three months? 

Yes . . ^ No 

[Case entries regarding routine letters sent , bus tickets, etc., 
do not. count as follow-up entries. The case record must re- 
flect, from intake to closure, meaningful contact between cl'lent 
and counselor at intervals not to exceed 90 days. Errors will: 
be councGd only *for the last 12 months. 

2160] 
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case entries that follow the required format? 
Yes Ko 



[RA-29 entries must include the following thrtje points;- 

1. Reason for action. 

2. Progress since last entry. 

3. Next planned action, the date for this action and 

responsible parties. 

Clerical entries will not be evaluated here.. 
^2150] 

that a 4337 or 4537-N (Financial Needs Analysis) wn^ properly 
cospleced and used? - . 

' Yes ; No N/A 



[There should be a 4537 or 4537-N for each year a client is in 
school. Financial aid recor.inendation on 4537 's must be followed 
or changes documented on Part C. ^ 

4537's or 4537-N's should be used for vocational/technical 
schools unless there is docurnentation^ of the school's inability 
to cor.plete an analysis and/or documentation that the school is 
not eligible for financi-al aid. 

The case .record must address the following questions: 

Are problems with financial aid resolved? 
Are exceptions carefully documented? 

An N/A response can be used only where the client has not been 
in a training program, where the school *s program is less than 
six .T.cnths in duration, the school is not eligible for financial 
aid, or a 4537 cannot be completed. 

7530, 7534-38] 

that statuses have been properly used? 
Yes No 



[2I^0j 

that a second injury wallet card was issued when appropriate? 

Yes No K/A 

[U'allot cards are issued as early in the rehabilitation process 
as possible - cards .should be issued by status 10. Check N/A 
for clients not eligible for second injury certification. 

5700-5735] 
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thnt a second injury employer cercif icace was issued when the' 
client: be^an work? 



Ves \'o n7A 



[If client elects not: to use an employer certificate, document: 
the reason(s ) . 

Check N/A if there is docuirtentation of client/enployer refusal 
or for individuals who do not Qualify. 

3700-5735] 

^^^^^^ appropriate fiscal procedures v;ere follc;'.;ed for ail cost"' 
services? 

Yes ^ No N7A 

(Forr:S will be reviewed for required signatures, start daces, 
bids and supporting case file entries. . Check N/A if no cost 
services were provided. 

The following forms will be reviewed*.' 

R.-\-2912 (Request for Service) 

RA-3S2A (Authorization-Amount: Change) 

R.-\-A109 (Au t:horizaLion for Service) 

R^\-^109D (Authori2at:ion To Provide Direct: Payment) 

rjv-4110 (Billing for Service) 

Ri\*-AlS3 (Authorization) 

l^\-^657 •(Uehabilitat:ion 'Client Vehicle Inspection Report) 
J Emergency Payment Documents 

?j\-4 587 (Bids and/or -Quotations for Purchase of Appliances or. u 
Equipment for Client) 

7073-7176, 7818-782A] 

27. Is the client receiving Workers' Compen:;ation or Kc Fault: benefits? 
[Include pending and litigated cases.] . 

«> * 

• Yes No ' ' 

If yes . . . 

Ci'> is t:here a properly completed PvA-1^0? 

Yes Ko ' , N7a _ 

[NVa response* can be used only for :Co Fault, Railroad Fund and 
Fcueral'Civll Service cases.] 
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b. is there docunentation of follow-'up with insurer? 

Yes No N/A 

(The lAO notice r.ust be sent initially, then follow-up is ex- 
pected at 02, 0& or plan developnent, l\h? , anendment (s ) , status 
20, and/or closure • An 11/ A response can be used i-f ic has been 
determined by the Workers' Compensation Bureau that no further 
reimbursement is available.] 

c* is there docijmentation of effort to gain reimbursemei. t for reha- 
bilitation services? • / 

/' ■■ > 

Yes :o v/A ' • 



[There must be letters or doc\\:::?nted phone contact. N/A re- 
sponse can be used only after Workers' Con:pensation--Bureau has 
. determined that no further rei:2bursen:ent is available.] 

V7as the case closed in status OS, due to ineligibility? 

Yes >:o . 



If yes . . . 

a. is the reason for closure docuziented? 

Yes No 



[If client is found" ineligible due to absence of disability or 
snverity of disability, there nust be third party docunentation; 
e.g., medical, workshop r.-^ports. 

A875] 

b. was the RA-300-2 (Completed Referral Process and Change) or 
' RA-300-3 (Completed Case Services) conpleted correctly? 

Yes Xo 



[Review all ite^^s. 

. 5400, 5410, 5425 or 8500, 8510, 8525] 

c. is there a Droperly cor.pleced Certificate of Ineli'-ibility 
.(RA-2 914)? 

Yes Xo 
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cl« was the closure decision nace only nfLcr consulLation wiLh the 
client and/or an appropriate representative? 



[As a TT.lniuiuni, there nust be docunientation of a discussion with 
the client by phone. 

A880] 

was the client .referred to another agency at closure, if appro- 
' priatc? 

Yes xo N/A 



[There should be docur.entation of referral to another agency 
where there is a clearly defined need; e-g-, medical problems or 
a need for avocational activity. Check N/A if. referral to 
another 'agency is not needed- 

A875] " . 

was Lhe client notified ir. meriting of the reason for closure? 
Ves ^ ::o * K/k 

[irnere no letter is sent, the reason must be documented- Use 
N/A only where notification of closure would be de trimenLal to 
the client, where the client has died or where earlier corre- 
spondence indicates no kr.cvn address. 

488Qj 

was the client inforned in vriting of his/her right to appeal 
the closure decision? 

Yes :;o N/A 

[Use N/A .only where notification of closure would be detrir.ental 
to the client, where the client has died, or where earlier cor- 
respondence indicates no knovn address. 

^i8S0, A911] 

v;as the client notified that he/she could reapply for services? 
Yes \ No N/A 

[Use N/A only v;herc notification of closure v;ould be delrimentnl 
to the client, where the client has died or whore earlier cor- 
respondence indicates no knovn address. 

4880, A911] 
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i- was client: inforined of the annual review of his/her closure? 

v^s :,-o ::/A 

[N/A is used for cases closed due to absence of disability or 
vocational handicap. 

• A900) 

V/as the case closed in status OS "for reasons other than ineli':>i- 
bility?" ^ 

Yes 

1 

If V'^s, . . . \ 

a. was the reason for closure documented? 

Yes :o ; 

[Efforts to contact the client and/or gain cooperation must be 
documented. ."Client refusal" describes situa^tions where the 
client specif ically , declines services.] \ 

b. was the KA-300-2 (Conpleted ?veferral Process and Change) or 
R^\-300-3 (Coiiplered Case Services) cor.pleted correctly? 

i 

Yes ::o 

[Review all ice^s. * \ 

\ 

5A00, 5410, 5^25 or 8500, 8510, 8525] 

c was the client referred to another agency at closure, if appro- 
priate? V, 

Yes . :o X/A \\ - 

[There should be docunienta tion of referral to another agency 
where chere is a clearly defined need; e.g., -.edical problems or 
a need for avocational acciviry. Use >;/A if referral to another 
agency is not needed. * , | 

1 



1 



A875] 

d- was the cl ient" no t if iec in writing of the reason ror closure? 

Yes :Co N7A \ 



[Use X/A only -where notificarion of closure would 6e detriniental 
to the client, where the client has died or where 43rlier cor- 
respondence indicates no known address. 

8030, 8070, •8076] 
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was the client ':ncd in writing of his/her ri.',ht to appeal 

the closure decis;.on? 

[Use NVA only where notif ica t ion ^of closure would be detrimental 
to the client, where the clienc has dic:d or where earlier cor- 
respondence indicates no known address. 

A875, A880] • ^ 

30. Was the case closed in status 28 or 30 for reasons of ineligibility? 

Ye s . No 

[No manual reference currently available.] 
If yes . . . ' 

a. was the reason for closure documented? 

Yes No 

[8050] 

b. was the RA-300-3 ^ -o:. leted Case Services) conpleted correctly? 

Yes No 

[85G0, 8510, 8525] ^ 

c. in cases of closure due to ineligibility, is there a properly 
coiTipleted certification of ineligibility? 

Yes No 

[Uo rianual reference currently available.] 

d. if ineligible, was the closure decision ir.ade only after con- 
sultauion with the client and/or an appropriate representative? 

Yes No 

[No manual reference currently available. Use N/A if referral 
to another agency is not needed.] 

e. was the client referred to another agency at closure, as appro- 
priate? 

Yes No N/A 



[There should be. documentation of referral to another agency 
whcre^there is a clearly defined need; e.g., nedical problems, a 
need for avocational activity.] 
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does the case record show if the action taken and outcome v;ere 
reported to other ag.encies, as appropriate? 



Yes No NVA 

[SOOO] * , 

was the client notified in writing of the reason for closure? 

Yes No N/A 



- [Use N7A response only if notif icatton-^oT closure would be det- 
ri^nental to. the client, wher^e^the^lient has died or earlier 
correspondence indicates^'no known address. 

8030, 5070] 

h. was the client informed in writing of his/her right to appeal 
the closure decision? 

Yes No N/A 

[Use ^^^A response' only if notification of closure would be det- 
rir.c:a:al to the client,, where the client has died or earlier 
co'rrespondence indicates no known address. 

, ' " ^ ■ * ■ / 

No nanual item.] 

i. was the client notified that he/she could reapply for service? 

Yes No N/A 

[Use N/A response only if notification of closure would be 
deeri::.ental to the client, where the client has died or earlier 
correspondence indicates no known address. 

No manual item.*] 

j. if closed too severe, was client informed of the annual review 
of his./her closed case? 

Yes No N/A 

[Use :i/S\ if case is closed for reasons other than "too severe." 

8530] . . 

Was the case closed in status 28 or 30 for reasons other than in- 
eligibility? 

Yes No 
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If yes . , . . 

a. is cho reason for closure documented? 

Ves No 

[Efforts to contact the client and/or gain cooT^eration nust be 
-docunenced. "Client refusal" describes situations where the 
client specifically declines services ■■ 

\ 

8050] 

b. was the RA-300-3 (Completed Case Services) completed correctly? 

Yes i\"o 



[3500, 8510, 85-25] 

was the client referred to another agency at closure, as appro- 
priate? V . , ^ VV 

Yes J No ^7A 



V ■ 
[There should be docunentation of referral to another ac»ncy 
where there is a clearly defined need; e.g., medical problems or 
a need ror avocational activity. Use N7A if referral to another 
agency is not needed. 

A875] 

d. does the case record show if the action taken ar;d outcome :^ere- 
reported Co other agencies, as appropriate? 

Yes No - .. Is'/ A 

[SOCO] ' ^ 

e. was the client notified in writing of the reason for closure? 

Yes No _ -^j^ 

[Use- N/A response only if notification of closure would be det- 
rir-ntal to the client, where the client has died or earlier 
correspondence indicates no known address. 

8050," 8070, 8076] 

f. was the client informed in writing of hi'^her right to appeal 
the closure decision? 

Yes No js;/^ , , . 



(Use .\7A response only if notificaton of closure would be det- 
riniental to the client, where the client has died or earlier 
correspondence indicates no known address."* 

8050, 8070, 8076] 
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Was the case closed in status 26? 

Yes No 

If yes, does the case record ... 

a. describe the basis on which the client was considered- reha- 
bilitated? 



Yes 



i\o- 



[There eust be documentation of follow-up with tha client and 
possible, the employer, regarding the client»s adiuscnenc on 
job . . ^ 

7950, 8025, 8075, 8100] . ' . 

b. describe Che type of job, wage and length of employment? 

Yes No 

_ ,[8070, 8075] 

c. outline. Che availability of post-emplo>-;nent services and/or a 
plan for post-ernployinent services? 

Yes Xo 

[8025, 8070, 8075, 8700] 

d. . contain an RA-300-3 (Conpleted Case Services) correctly coni- 

plc ted? 

Yes ^ ' [Co 

[8500, 8510, 8525] 

e. show chat the client completed services planned in tl'ic IWR? 
" and /or amendcentsTc 

Ves J Ko y 

'[7b25, 8025] " ' . ^ 

f. show that ongoing needs were address«d'^ 

" . ' ' \ Yes _^ ^ ^ ^ 

^ : .[8025] .;■ - ; - . 

■k /a '.■■'*': 

g. docurnerit that; the client is suitably employed? 

'Yes-^j^ ■ ' ko__ :- 

' (8100-8250] / • 



docuuen^C chac cvaluaLldn; ccunsciling and guidance were provided? 
Yes No 

[There u.ust he documenca Cion of counseling in the forni of RA-29 
entries or third party reports. 

s 

7200, 8025] 

docunient provision of substanti al services were provided? 
Yes No 

[If t'r.-2: client accepts en.ployr.er.t thar is not consisteat v;ith 
the planned vocational objective and the counselor cannot 
clearly docunent a relationship between services provided and 
the vocational outcone, the case cannot be closed in status 26- 

\ 

7025, 7200, ygOO, 8025, SlOCj 

shov; that the clv.ent .was notified that there would be an annual 
r e v i e v; of h i s]/ h e r sheltered e- pi oyv.er, t ? 

. Yes No N./A 

[Check *^N/A" for those .individuals who were, not closed in shel- 
tered er.ploy:;^.en'd . 

8250, 8660] . ^ ' - 



1 



STATE OF MICHIGAN l^^**'^ 




WILLIAM G. MILLIKEN, Governor 

DEPARTMENT OF LABOR 

William Long, Director 



COMMISSION FOR THE BLIND 
309 N. WASHINGTON 
P. O. BOX 30015 
LANSING, MICHIGAN 48909 



May 1, 1981 



Susan Stoddard 

Project Director 

Berkeley Planning Associates 

3200 Adeline Street 

Berkeley California 94703 

Dear Ms. Stoddard: 

In respo'nse to your recent correspondence to Philip Peterson, I 
am forwarding information about our case review system, and a 
copy of our static caseload report. 

The Commission for the Blind has a casework operations .review 
which we atlemot to conduct on an annual basis. We use supervisory 
staff to review samples of cases from each district, and orepare 
a report based upon regional results. ^ 

\ 

Our static caseload report is printed on a quarterly basis . Cases 
are flaaed based upon the number of months in a specific status, 
and when flaged, are identified on the static caseload report 
This gives us a management tool for supervisors t6 review with 
■field' staff. / 

I hope this information is helpful to you. If I can be of any 
further, assistance, please do not hesitate to call upon me. 

Yours very truly, 

/ J 



Harold Payne, Supetvisor 
Rehabilitation Services 
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Attachment 

cc:. Philip E. Peterson 



" CASE REVIEW FACTOR S 

1. Referral I n f o nna t i o n 

This factor is for determining the appropriateness of a referral. 
A case is judged to have a problem in this areaif it does not con- 
tain the minimum of required referral information such as name, 
birthdate, address, and any indication of disability; or*the case is 
considered to be problematic if it is reopened and, in the opinion of 
the reviewer, the reopening does not appear to be, justified. 

2. Diagnostic Information^ x 

This factor is to determine the appropriateness of diagnostic 
information. Reviewers examine case files for an opthamological report 
with a diagnosis that evidences eligibility for services. A state- 
ment of visual acuity and a prognosis would be there and in the case 
narrative. An audiological evaluation should be-offered, but it is 
not a requirement. Note that a hearing exam was offered should also 
be in the narrative section if it is refused. 

3. Use of Medical Consultation 

This factor is to determine if, the medical information is reviewed 

by the Agency *s medical consultant as evidenced by that person's 
signature... ■ ' 

4. Certificate of Eligibility 

This factor is for including a completed Certificate of Eligibility 
in the case file. 

'5, Case Service Status 

•3 

This factor is to determine that each status described in the case 
narrative matches the caseload flowsheet, and cases are examined for 
reasonableness of time in a status. It is anticipated that a client 
should be in referral status (00) no longer than three months, in 
Applicant Status (02) no longer than six months, or in Training Status 
(18) no longer than one year, etc. without an update of the case 
narrative, 

6. IWRPS .^;/^-, 

This factor is to determine the completeness of the Individualized 
Written Rehabilitation Program form. 



' SSDI/SSI Information £ ^v'-'V/W'.-' /,•/■// ' 

This factor is to determine if case service costs have been documented 
•for proper funding. This is evidenced by inclusion of the SSDI/SSI 
Vertification of Benefits form, correct completion of the Special 
Selection Criteria Certificate, and proper coding on the flowsheet. 
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8. Case Follow-up 

This factor is to determine that reasonable and adequate contact has 
. been made with the client. The reviewers' function is not to question 
counselor judgment, but to' review for activity and an explanation. 

, 9. Case Supervision . 

Supervisors should be reviewing cases and assisting field staff when 
.necessary. / 

10. Case Recor(jing 

Thi.s factor is to verify that an"a>dequate case record is maintained. 

11. Case File Order ' . , 

Cases should be assembled in an orderly fashion, and this factor is 
dei^prmirf^Sg-if that' condition has been met. There is to be a separate 
section/on each of the following categories: 'Documents, Training, 
Narrative, Correspondence, Financial, and Obsolete. 

12. Significant CFB" Involvement * ^ 

This factor is to determine if a client has acivanced in status at a 
reasonable length of time. 
13. Other Resources , - ^ wVv-' r' /'^'^> ' ' 

There should be evidence of irivostiqation of similc-ir bcMiofits to servo the 
needs of a client. This is particularly determined by inclusion of^a 
^ Similar Benefit checklist in the case file with the IWRP. 

14. Other ' , • 

This factor is for identification of any special item not applying 
to any of the previous thirteen. 
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J^SDI/Tr/ . STAT SSI/SF ENTER 



IH STATUS 




2 / 

i 



CASE DATE 
■^^1— MdE STAT SSI/SF ENTER IN STATUS 



1 / 0/0 1/1 C4-80 



c/: 



18 



0/: 



C4-79 



1(0 ?i__0/0 C9-BC' 



10 
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CASE fllIMB 



CASE NAf'iE 







\ , UATE IIOMTHS 
''^-^ SSDI/TF \ STAT 5SI/SF ENTER 



1/0 
0/0 



18 
18 



A/ 



18 



■O/O 
0/0 



12-79 
CB-7Q 



A/0 



IN STATUS 



U 
18 
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innesota Division of Vocational Rehabilitation 

Third Floor, Space Center, 444 Lafayette Road 
St. Paul, Minnesota 55101 



Telephone 612/296-5616 
TTY 612/296-5643 



April 8, 1981 



Susan Stoddard 

Berkeley Planning Associates 
3200 Adeline Street ^ 
Berkeley, CA 94703 ' . 

Dear Ms . Stoddard : 

I have received your recent\request for ir.aterial used in Minnesota 
Vocational Rehabilitation for case flaging and quality assurance* 
Enclosed is a copy of the. case review questionnaire used by our 
program evaluation unit which reviews a random sample of cases in a 
different field office each month. Several of these questions also 
relate to undue delay. 

Also enclosed is a copy of the counselor's. manual chapter which 
describes our ^M:andards and procedures for identification and review 
of cases which may be delayed. Our counseling supervisors monitor 
this on a monthly, basis. 



If you have any further questions on any of this material, please feel 
free to contact Roberta Pisa at 612/296-5645 or Gene Hogenson at 612/ 
296-1718. 




Edwin 0, Opheim 
Assistant Commissioner 
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GENERAL 
Complete for All Cases 

A PPLICATION / 

^ ■ ■ . / ■ 

K Is there a signed application for VR services ( or letter requesting 
services)? Yes No 

2. Was information necessary for eligibility determination requested as 

promptly as possible? Yes. No , ( Yes can also be used if 

information was available at referral and request not needed). 

3. If eligibility has not yet been determined, is the delay justified? 
Yes No X (Case beyond 02) - 



CASE HISTORY NOTES 
» ~ ■ 

Is initial interview recorded? Yes No 



5. Is initial interview recorded adequately? 

Yes No X (Not recorded) 



6. Are case notes (wherever recorded) sufficiently complete to give a picture 
of the client's progress to date? Yes No . 

STATUS CODE 

7. Is current st.^tus code correct (i.e. reflects present stage of ac'^.ivity)'? 
Yes No 

EXTENDED EVALUATION (05) 
Complete for all cases which have ever been in status Oo 

8. Has the eligibility form been completed, signed .^nd dated? 
Yes No (If no, go to question #10) 

9. Does it adequately document reasons ror extended evaluation? 

^ -^-^ yes No .- ~ ; ■•- ;- 

10. Does information in file support extended evaluation decision? 
Yes No 

11. Is there an IWRP for determining ability to benefit from VR services? 

(If No, go to question #13) Yes ^ No X (06 prior to 7/75) 

J 

•12. ^ Is the IWRP signed by the client (or a note recorded that the client does 
' not wish to sign)? Yes No 

October, 1980 ' Page 1 
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Does the IWRP include: 

Q 

13. Specific Services? Yes 

14. Projected start date for each service? Yes 

15. Anticipated duration of each service?"^ Yes 

16. Procedure and criteria for evaluation of progress? Yes 

17. Are the services specified in the plan being provided? Yes No 

18. Was a thorough periodic assessment of client's progress made at least 
every 90 days to determine the results of service and assess whether an 
eligibility decision could be made?' Yes No 

19. Was client accepted or rejected for services as soon as evaluation 
indicated ability or inability to benefit? 

Yes Mo X (Not yet indicated) 

20. Was the case in status 05 less than 18 months? Yes No 



No 
No 
No 
No 



If physical or mental restoration services were provided in status 06: 

21. Was medical or psychiatric consultant approval received prior to 
authorization? Yes Mo X (Not provided) 

OS's 

22. Was IWRP Part B Closure Notice (or equivalent letter) sent to client? 
Yes Mo 

23. Is there a c"l os"ing summary in the case? Yes No 

24. Are the reasons for closure stated? Yes No 



■25. Did Counseling Supervisor initial case closure? Yes No 

26. If client was closed for reasons such as not interested, unable to locate 
refused services, or failure to cooperate, were appropriate efforts made ' 
to involve the client in the rehab process? 
Yes No X (Not applicable) 

If the applicant was determined ineligible, answer tiic following: 

27. Has a certificate of ineligibility been completed, siqtiad' and dated? 
Yes No X (N/A) , 

28. Does information in case file support ineligibility d'=»rision? 
Yes No X (N/A) 
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ELIGIBILITY 

Complete for AM Cases Status 10 and Beyond | 

29. WqS there a current general medical in the file when the case was 
accepted? Yes , ' No 

30. If the disbaility is emotional, was there an examination by a psychiatrist 
or licensed psychologist? Yes No N/A 

31. If the disability is mental retardation, was there a psychological 
evaluation (including a valid measure of intelligence, social functioning, 
and educational progress and achievement)? • Yes No N/A 

V, 

32. If there is a hearing impairment, was there an evaluation of the \ 

, audiological system? Yes No N/A | 

Are the records comprehensive and recent enough to support the decision\that: 
(Use ? when the decision is questionnabl e but you wish to give the 
counselor the benefit of the doubt) l. 

33. the client has a medically recognized disbaility? \ 
Yes No ? 1 

34. which- constitutes a substantial handicap to employment for this client"^ 
Yes No ? \ * 

35. and that there was a reasonable expectation the client could benefit from 
services in terms of empl oyabil ity? Yes No ? \ 

36. Was information reviewed by the medical or psychiatric consultant (or by 
. the supervisor if prior to 10/79)? Yes No 

37. Is there an eligibility form (completed, signed and dated) in the file? 
Yes No 

' • ^ 

38. If yes, does it adequately document reasons for eligibility decision"^ 
Yes No ' X (No Form) 

39. Was eligibility determination made without unduei>delay Yes ' No \ 

, - - 

40. Are the disabi] ity codes on the CSR justified by the medical and/or ■ 
psychological' information? Yes No 

41. Are secondary disabilities coded? Yes No None (x) 

42. Is "severe disability" on CSR coded correctly ? Yes No 



43. If case is still in status 10, is the rehabilitation plan being developed 
without undue delay? Yes No ^ X (Case beyond status 10) 
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' VOCATIONAL DIAGKTiSIS S PLAMNIIiG 
Complete for all cases in status 12 and beyond 

44. ..Is there a written" vocational diagnosis? Yes fio 

ANSWER 45-50 only for vocational diagnosis written after September, 1978. 
Does thex vocational diagnosis reflect: 

45. the significant aspects of a dirinnostic study? , -Yes f- 



46. factors creating problems' in obtaining or retaining 

employment? Yes No 

w 

47. Conclusions about the relationship among the clients 

assets and liabilities? ^ Yes No 

48. V.'h.ich proble;n ar^eas can be treated or resolved? Yes No 

49. Possible alternatives for the client? Yes Mo 

50. .-Does the vocational di agnosis go beyond a sumiiiary of ^ 
data found elsewhere in the file? Yes ^ No 

51. Is there an IWRP? Yes No 

IF YES, answer 52-63, IF NO, skip to question 64. 

Does the IViRP- include: 

52. Specific services to be provided? Yes ^ No 

53. Specific vocational objective? Yes No 

54. projected start date for each service? ' Yes j No 

55. anticipated duration of each. service? Yes No 

5u. procedure f< criteria for evaluation of progress? Yes No 

57. completed financial section? Yes No 

53. Client signature? Yes No 

59. Counselor signature? Yes Ho 

60. Is the IWR? dated? Yes ' No 

61. Is tlve plan appropriate for the'needs and prob,loi:is of 

the client. .'. Yes No 

62. Is the vocational objective appropriate? Yes No 
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63. Has there been a formal annual review of the IWRP (if IWRP is at least one 
year old) by the counselor and client, parent or guardian? 
Yes Mo X (Plan less than 1 year old) 



64. Have plan amendrents been written when necessary? 
Yes No N/A (x) 

65. Does the case file demonstrate active^participation on the part of the 
c1 lent 1n planning? Yes No . < 



66. Does the case file demonstrate active Involvement on the part of the 
counselor in planning? Yes Mo 



.57. Was the rehab plan developed without undue delays? Yes No 



68. If case is still in status 12, are. there undue' delays in services being 
Initiated promptly? Yes No X..(No longer 'in 12) 



SERVICE PROVISION PHASE 
(14, 16, 18, 24) 

l9. Does case file have reports of client progress from schools, facilities 
etc.? Yes No N/A 



70. Does case file indicate that client's program is being monitored so that 
termination can be made when client has achieved maximum benefit? 

If agency funds have been spent since July, 1975, for nondiagnostic services: 

71. does case file include documentation that a search for similar 
benefits has been done? 

Yes No Not required (z) N/A (x) • 

If physical or mental restoration services were provided: 

72. was medical consultant approval received prior to authorization? 
Yes No N/A (x) 

73. is there documentation supporting the determination that the clinical 
status of the individual is stable or slowly progressive? 

-Yes No N/A'(x) 

74. If client is or was in status 14, does case file reflect regularly 
scheduled counseling sessions are occurring? 

Yes No X (Not in 14) " 

75. If client is or was. in status 14,- was there an IWRP specifying counseling 
and guidance (non-routine) as the only service necessary? 

Yes No - . X (Never in 14) — 

76. Are reasons for any changes in plan explained? 
Yes No N/A (x) " ^ 
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77. Are the services specified in the plan or amendments being provided? " 
Yes No Status ^^ (x) ■ 

78. Has DVR provided substantial service? Yes , Mo ? 

79. Have services been provided promptly? Yes No 

PLACE ;<E NT • 
Complete for all cases in status 20 or beyond 

80. Does the case file reflect how placement is to be accomplished? 
Yes No 

Which placement services (are being) (were) provided? (use N/A if a service 
not necessary or appropriate for this client. Use No only if the service 
should have been provided and was not). , 

81. job seeking skills training? 

82. job development? 
■ 83. job leads? 



Yes 


No 


N/A (x) 


Yes 


No 


N/A (x) 


Yes 


No 


N/A (x) 



84, 



If client IS not working, does the record indicate the counselor has tak 
sufficient steps to help the client find employment? 
Yes No Client is working (x) 



85. If cl ient js working, does the record indicate, counsel or has provided 
appropriate follow-up services? 

Yes No Client not working (x) 

86. Did (or- is) placement ■occur(ing) without undue delay? Yes No 

26 's 

87. Does case file have a closure summary? Yes No 
IF NO, go to question #95. 

IF YES, does it include the following: 

88. Description of why it 1s dGtormlned tha client has 
made a satisfactory adjustment? Yes 

89. summary of services provided? Yes 

90. job title and/or duties? Yes 



91. empl~o3^n"a.ue and address? Yes 

92. salary? Yes 

93. date job began? . Yes 
October, 1980 Pag^ 5 



No 
No 
No 
_ No 
No 
5\ No 



94. Did counseling supervisor initial approval of case closure'? 
Yes No _ v 

95. Has plan or plan ansndment been completed insofar as possible' 
Yes No 

95. Does job appear compatible with client' s abil ities and problems'? 
Yes No ' . . 

97. Is client's employrent consistent with the objective for which services 
have prepared the client? Yes 'No ■ ■ ". 

98. If client received training, was it related to the job family in which 
he/she was placed? Yes No No training (x) 

99. V/ere appropriate follow-up services provided prior to case closure'? ' 
. Yes No 

100. Uas client employed at least 60 days before case closure"? 
■Yes No , 

■ 101. Does case show indication of counseling activity? (check one). 

a- None b. Mild _____ c. Moderate d. Extensive 



102. Did services provided by the agency affect the outcome (rehabilitation) in 
an identifiable positive way? -Yes- No 

103. Does the case record demonstrate that the services provided were necessary 
and .led to improved empl oyabil ity? Yes No 

104. Was client notified in writing of case closure? Yes No 

" 28's/30's 

105. Was IHRP Part B closure notice (or equivalent letter) spnt to client"? 
Yes No 

105. Does case indicate reasons for closure? Yes No 



107. Is there a closing summary in the case? Yes No 

108. Did- Counsel ing Supervisor initial case closure? Yes No 



109. If client was closed. for reasons such as not interested, unabje JoJ ocate. 
refused services or failure to cooperate, were sufficient efforts made to' 
involve the client in the rehab process? 

Yes No N/A (x) . 

110. For a case vvhere services under a written program. were terminated on the 

^ basis of a determination that the individual was not capable of achieving 

a vocational goa^l and no longer eligible was a certificate of 
• ineligibility completed? ' Yes No _ _ N/A (x) . 
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' ' Pe^ [EMPLOYMENT 

Complete for casejs in status 32- anct-bayond 

111. Is there sufficient doGuinentat\on to justify the need for post employrent 
services? .Yes ^ No \ . 

112. Is there an IWRP for Post Err.pl oyment? Yes Mo 

IF YES, does it . .v! 



113. describe the j:ype and extent of services planned? Yes No, 

114. indicate how services will be provided? Yes No 

115. identify specific objectives? ' Yes No 
... . 

116. Were P. E. services necessary .fo help maintain empl oyrent' 
;,, Yes No . ■ 

- ' . 'i 

117. If P. E. services have been terminated, is there a record Cf the present 
employment situation? Yes No X (Still in 32) 
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DEPARTMENT OF 
SOCIAL AND REHABILITATION SERVICES 



TEOSCHWINOEN. GOVERNOR 



PO. B0X4210 



John La F aver 
Di rector 



STATE OF MONTAMA . 



HELENA, MONTANA S9604 



April 13, 1981 



Susan Stoddard ' ^ 

Project Director 
Berke-ley Planning Associates 
3200 Adel ine Street . 
Berkeley, CA 94703 

Dear Ms. Stoddard: 

Enclosed are copies of our case Quality Control Sheets. I 
nope you find them of help. 

?nmn;;?irf5"cJ''^"?t^°- flagging is review of a master 

computer list This is practical because of the very small 
caseloads in the State of Montana. 

Sincerely, 

,f •4/- ^ 



Gary W. Lee 
Program Manager IV 
Visual Services Division 
Social and Pxehabilitation 

Services 

(- 



GWL : gmc 
End . 
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Irpv. 1/81) 



(a) MONTANA DEPT. OF SOCIAL & REHABILITATION SERVICES 

•Visual Services Division 

PROCES SIIMG CHECKLIST/QUALITY CONTROL 



REVIEW 



Name: 

Address: 

SSN: 



Counselor No. 
Status: 



Review Date: 



KgyS: 

A ^ Adequate p = D©f iciency N A - Not Applicabia 


1 , COMMENTS: 

1 Outline corrections newsary to olimirute dofisioncki* — " 
I V e it«blish deftrilines for corrections. 


1. APPLICATION - FILL IN THIS SECTION FOR CASES 
IN STATUS 02 AND 08 • 


T 




(1) REFERRAL & SOURCE - INFO. COMPLETE 




(2) APPLICATION / RELEASE OF MEDICAL INFO. 






(3) AUTHORIZATION FOR INITIAL EXAM 






(4) TIME IN STATUS 00 LESS THAN 3 MONTHS 






(5) INITIAL CONT. MEMO + R-300 INIT. PROMPTLY 






11. PLANNING FILL IN THIS SECTION FOR STAT. 10 






(1) MEDICAL WITH RECOMMEND. FOLLOWED 






(2) PSYCHOLOGICAL * 




V; 

\ 


(3) SOCIAl iNFDRMATinN — IMPMiniMr: c:^/lD / 
EDUCATION / WORK HABITS 








(5) SIGNIFICANT INFORMATION SUMMARIZED 




(6) ELIGIBILITY DETERMINATION 




(7) ECONOMIC NEED DETERMINED 




(8) TIME IN STATUS 02 LESS THAN 3 MC^THS 




(9) TIME IN STATUS 06 LESS THAN 18 MONTHS 




III. SERVICES PROVIDED - FILL IN THl's' SECTION 
^ FOR CASES IN STATUS 12 AND 30 




' " ■ ' * - • 


(1) MEDICAL RECOMMENDATION F0L4-0WED 






(2) REASON FOR SELECTION OF OBJECTIVE 




(3). IWRP WRITTEN / AMENDMENTS COMPLETED 




(4) OTHER AGENCY'S ROLE DEFINED 




(5) TIME IN STATUS 10 LESS THAN 6 MONTHS 




IV. SERV;CHS - FILL IN THIS SECTION FOR CASES 
IN STATUS 20 ^ ^ 

. 






Ml 1 1 ivi c u T M N U L>U N o 1 o i c |\J 1 W 1 1 n 1 W n r. 






- - R. T. & 0/M SERVICES EVALUATED — 




■ ■ . .. . V ■ . 

* V 

» 


(2) AMEND. & INTERRUP. EXPLAINED - 




13) GAPS IN CASE RECORDINjG 




(4) AUTHORIZATION FOR SERVICES 




J5) , TIME IN. STATUS 14 LESS THAN 6 MOS. 




(6) TIME IN STATUS 16 LESS THAN 12 MOS. 




• (7) TIME IN STATUS 18 LESS THAN 4 YEARS 




V. PRE-CL05URE -1 fIlL' IN \THIS SECTION FOR 
CASES IN STATUS 26- 28^. y 






(1) PLACEMENT PLAN . MADE & FOLLOWED 






(2) METHOD -OF PLACEMENT SHOWN 




, {3j AOEOUATE FOLLOW-UP. 60-DAY MINIMUM 




r7^p"(4) CLOSURE CONSISTENT WITH IWRP 




/ ,, , iJiy 



KEYS: 

A Adeouate D *^ Dofii^ienrx/ NA ^ Nnt AnDtii?;ihl@ 


COMMENTS: 

Outline corrections necessary to eliminate deficiencies ~ 
establish deadlines for corrections. 


(5) TIME IN STATUS 20 LESS THAN 3 MONTHS 




• 


(6) ■ TIME IN STATUS 22 LESS THAN 3 MONTHS 
BUT MORE THAN 2 MONTHS 




.yi; CU0SU3E - FILL IN THIS SECTION FOR CASES 
. CLOSED IN STATUS 03, 26, 28, 30 






■ (1) POST-EMP; SERVICE EXPLAIN. & RECORDED 




r 

\ 


(2) PES NEED DETERM. /DOCUMENTED 




(3) CLIENT NOTIFICATION OF CLOSURE 




(4) PRUDENT USE OF FUNDS 




(5) REASON ^GIVEN FOR 03, 26/ 28, 30, 33, 35, 
37 CLOSURE WITH CLIENT VIEWS 




(6) ANNUAL REVIEW OF INELIG. 




(7) SSI/SSDI VERIFICATION' 




— - 


(8) SSC APPLIED APPROP. ON CERTIFICATE 




(9) CHRON. OF CASE FIL (STAT. CHGS. SHOWN?) 




(10) CASE FILE CLEARLY INDIC. FUND. SOURCE 




(11) REFERRAL SOURCE INFORMED 




(12) REUSABLE EQUIPMENT RECLAIMED OR 
TITLE RETENTION SIGNED OFF 




(13) EMPLOYMENT COMPATIBLE WITH HANDICAP 





REVIEWER: " ^ DATE: 



Date Deficiencies Corrected: COUNSELOR: 



. Pflge 2 ' (rev. 1/81) 
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sns-VSD-V5R-1 Xh) MONTANA DEPT. OF SOCIAL & REHABILITATION SERVICES 



i" . . Visual Servic-'f Division 

QUALITY CONTROL SHEET 



Indicate trenc 



DATE OF REVIEWS ^ 












TOTAt 


NO. OF CASES REVIEWED t> 












DEF 

D 
D 


. NO. OF DEFICIENCIES BY ITEM i>?^^^§^^ 


1. APPLICATION 




1 
i 










n) RErERRAL 8( SOURCE — INrO. COMPLETE 














12/ ^vVf^PrLlCA IlUN / hbLLASt Ur IviEDICAL INFO. 










r 




(3) AuTHORJicA 1 ION FOR INITIAL EXAM 














tAj TliViE IN STATUS 00 LESS THAN 3 ViONTHS 














(5) INITIAL CONT. MEIViO + R-300 INIT. PRO.uPTLY 














11. PLANNING * 














(1} MEDICAL WITH RECOMMEND. FOLLOWED' 














[2) PSYCHOLOGICAL 














(3) SOCIAL INFORMATION - INCLUDING EMP./ 
EDUCATION / WORK HABITS 














(0 APTITUDE INFORMATION 














(ii) SIGNIFICANT INFORMATION SUMMARIZED 














(6) ELIGIBILITY DETERMINATION 








— : — 1 






(7) ECONOMIC NEED DETERMINED 














(8) TIME IN STATUS 02 LESS THAN 3 MONTHS 












• 


(9) TIME IN STATUS 06 LESS THAN 18 MONTHS 














III. SERVICES PROVIDED 








• 






(1) MEDICAL RECOMMENDATION FOLLOWED 














(2) REASON FOR SELECTION OF OBJECTIVE 














(3) IWRP WRITTEiVJ /; AMENDMENTS COMPLETED 














(4) -OTHER AGENCY'S ROLE DEFINED 














(5) TIME IN STATUS 10 LESS THAN 6 MONTHS 














IV, SERVICES : ' i 










- 




(1) TIMELY AND CONSISTENT WITH IWRP.' 
R.T. & 0/M SERVICES EVALUATED 








5 






(2) AMEND. & INTERRUP. EXPLAINED ' ' 














(31 ^GAPS INXASE"~REC0RDINC 














(^) AUTHORIZATION FOR SERVICES 














(5) TIME IN STATUS 14 LESS THAN 6 * MOS. 














(0) TIME IN STATUS 16 LESS THAN 12 MOS. 














, ' (7) TIME IN STATUS 18 LESS THAN -^4 YEARS 














V, PRE--CLOSURE . . . 

• ' ... 1 








•• » ■ 






(1) PLACEMENT PLAN MADE & FOLLOWED 














(2) "MF^THOD OF PLACEMENT SHOWN 














(3) ADEQUATE FOLLOW-UP. 60-DAY MINIMUM 














^ (4) CLOSURE CONSISTENT WITH IWRP 




■ 
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1 


1 


TCTAU . 


NO. OP CASJtS RtVltVVED ^ 
""^ NO. OF DEFICIENCIES. fiY ITEM ^1 






— -~T 




DEFIC 
BY 


15) TIME IN STATUS 20 LESS THAN 3 MONTHS 


1 1 

\ I 


1 








16) .TIME IN STATUS 22 LESS THAN 3 MONTHS 
aUT MORE THAN 2 MONTHS 














.VI: CLOSURE 














" (1) POST-EMP. SERVICE EXPLAIN. & RECORDED 















(2) PES NEED DETERM. /DOCUMENTED 














(3) CLIENT NOTIFICATION OF CLOSURE. 


— -J 


1 


1 — 








(4) PRUDENT USE OF FUNDS 














(5) REASON GIVEN FOR 08, 26, 28, 30, 33, 35, 
37 CLOSURE WITH CLIENT VIEWS 














(6) ANNUAL REVIEW OF INELIG. 














(7) SSI /SSDI VERIFICATION 














/ IB) SSC APPLIED APPROP. ON CERTIFICATE 














— / 

/ (9) CHRON. OF CASE FIL (STAT. CHGS. SHOWN?) 














- (10) CASE FILE CLEARLY INDIC. FUND. SOURCE 














(11) REFERRAL SOURCE INFORMED 














1 (12) REUSABLE EQUIPMENT RECLAIMED OR 
! TITLE RETENTION SIGNED OFF 






j 








1 ^ , ^ 

1 (13) EMPLOYMENT" COMPATIBLE WITH HANDICAP 
I ■ 


1 


\ 
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REHABILITATION DIVISION 
OFFICE OF PLANNING, RESEARCH AND PROGRAM DEVELOPMENT 

SPECIAL PROJECT EVALUATION CRITERIA 



Pro.iect- Name: , Date: 



Evaluator: Project Director: 

Date of Last Evaluation: 

Project Proposal Review (Pre-Site) 
Stated Goals and Objectives of Project: 
1. 
2. 

3. ■■' ■ 

4. . ' 

5. . 
"6. 

Concurrent In-House Evaluation Criteria: 
1. 

2. ' 

3.. . , 

^- 

5.. 

Project Costs: 

1. Administrative Personnel $ - 



2. Professional Staff $^ 

3. Clerical .. 

• . - 

4. Other Agency- Contributions $_ 



5. Rent, Utilities $_ 

6. Equipment . $_ 



7. Other $ 

Cost per anticipated number of clients $ 

o : 
ERIC 



EVALUATION CRITERIA 



1.0 Client Services Delivery System 
1.1 Target Population 



1.1 
1.2 
1.3 
1.4 

1.5 

1.7 

1.8 

1.9 

1.10 

1.11 

1.12 



Number of 
-Number of 
Number of 
Number of 
Number of 
Number of 
Number of 
Number of 
Number of 
Number of 
Number of 
Number of 



Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 
Clients 



Referred : 

Accepted: 

Cbmpl eti ng Program; 
Continuing Program: 
Terminating Before Completion: 

Declining Services:^ 

as Mo-Shows: 



Severely or Totally Disabled: 
Non-Severely Disabled: 
at Grade Level 1 to 4: 
at Grade Level 5 to 8: 



at Grade Level 8 and Above: 



1.2 Target Population/Referring Aoencv 



a) BSB 










1 . 1 . «k/ 




I.I./ 


1 • 1 • O- 


1 . 1 . 


1 . 1 . 1 U 


1 . 1 . 1 1 


, 1 . I . 1^ 


b) VR 


























c) BADA 


























d) ABE 


























e) 


























f) 


























q) 


























h) 


























i) 


























j) 



























Correl ations/Comments ; 
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Client Success ~~ - 

1.2.1 Percent of Clients Completing Program: 

1.2.2 



Percent of Clients Obtaining Employment: 

1.2.3,- Percent of Clients Maintaining 60 Days Employment 
1.2./ ~ 
1.2<^ 
1.2.6 
1.2.7 

1.2.8 

1.2.9 Percent of Clients in Job Family for Which Applied: 

1.2.10 Percent of Clients in Job' Family for Which Trained: 
CI ients' Success/Prograr^ verages 

Average Hourly Salary bf-Appii cants :.__ 

Average Hourly Salary at Completion: : 

• Average Grade Level of Ajjpli cants: 

Average Grade Level at Completion: 



Percent of Clients With Two or More Job ..Interviews: 
Percent of Clients Obtaining Competitive' Employment! 

Percent of Clients With Sheltered Employment: 

Percent of Clients Self-Suff icient:_ ~ 
Percent of Clients Satisfied With Job; 



1.3.1 
1.3.2 
1.3.3 
1.3.4 



Efficiency of Operation 



1.4.1 
1.4.2 
1.4.3 



Average Case Service Cost Per CI i eht: " ' 

Average Duration of Client Services: 

Average Cost Per Service/Percent of Individuals 



,4.4 
.4.5 



a) 
b) 
c) 
d) 
e) 
f) 



Service 



Cost 



Percent of Individuals 



a) 
b) 
c) 
d) 
e) 

f) f) 
(Elapsed Time) Average Number of Weeks Clients in Project; 
Average Number of Hours Per Week Clients in Project: 



b) 
c) 
d) 
e) 



Quality of Life Improvement 



1.5.1 
1.5.2 



1.5.3 



percent of clients surveyed indicate client satisfaction with 

^ J / II . . • ^ II 



1.5.3.1 
1.5.3.2 
1.5.3.3 
1.5.3.4 
1.5.3.5 
Reasons for Failure 
Where applicable, a 



program and/or "new life. 

percent of clients surveyed fol lowing completion indicate 

$ increase in wages. 

percent of clients surveyed (or client records reviewed) 

following project completion indicate improvement in their: 
' " " - nutrition and health. 

extent and type of social contact, 
recreational activity ability, 
physical endurance. 

self-image, attitude and motivation to become employed. 



random sample of case files closed in Status 08, 28 and 30 
will be made as follov/s^ 

1 .6.-1 — 1 - cases -Status 08 to ascertain why they were not accepted^; 

These may 



1.6.2 



WW WW WW III niijr uiicjr wci c iiuu uv-v-cp 

cases Status 28 or 30 for reasons not rehabilitated. 



be compared to clients statements in interviews. 



INSTRUCTIONS: Indicate "Less" for less than adequate; "Adequate"; or "More" for more than 
adequate. 

2.0 Administration " 

2.1 Personnel 

2.1.1 Personnel are well-trained and qualified: 

2.1.2 Personnel are aware of their individual 
responsibil i ties : — 

' 2.1.3 (Where applicable) consultants are necessary 

and well-qualified: 
' 2.1.4 Personnel have demonstrated ability to ~^ 

communicate well with Rehabilitation Division: 

2.1.5 Personnel have had previous experience in " 
occupational skil 1 training: 

2.1.6 PersonneT^exhibit significant administrative ~ 
liaison between project and funding agency: 

2.1.7 r The number of professional staff is sufficient [ ~ 

to serve the clients: 

2.1.8 The number of clerical staff is sufficient to \ ~ 
support project operations: 

2.2 Budget — 

2.2.1 Accurate and complete records are kept on 
encumbrances, expenditures, etc.: 

2.2.2 Expenditures/costs do not exceed projections: " 

2.3 Clients Records ' — 

2-3.1 percent of random sample files reveal: 

2.3.1.1 Completed evaluation forms including 
skill assessment, general observations, 
specific goals, recommendations: 

2.3.1.2 Clients satisfaction questionnaire: 

2.3.1.3 Pre- and Post-job applications or, 
other tests: 

2.3.1.4 Reasons why leaving project, where 
applicable: 

2.4 Reports ' 

2.4.1 . Project reports are made to funding agency as ^ 

required: 

2.5 Resources 

2.5.1 Facility square footage and design are indicative 
of project needs: 

2.5.2 Equipment is in working order and is being [ ^ 
utilized for project purposes: 

2.5.3 Supplies are sufficient in number and quality 
for project use: 

2.5.4 Travel time and costs are appropriate to project 
^-_PJjrp^Qse.s.:' 

3.0 .Training Projects ' • , 

3.1 Training in occupational skills and related services 
includes: 

3.1.1 Work Evaluation: 

3.1.2 Work Testing: ^ ' ' 
'3.1.3 Job Tryouts: 

3.1.4 Occupational Tools and Equipment Required for 
Each Training: 



er|c Hg 




3.2 Training teaches specific job skills: • 

3.3 Selected occupational skill training areas are justified: 

3.4 Training areas .are appropriate to current employment - 

opportunities: 

3.5 Project has procedures for placing clients upon completion: ^ 

3.6 Group activities are usad when there are, sufficient 

nunnbers of clients with 5iin'*lar needs: ' 

A ^a: " ' xy Ziiprov^^nienT " ^ojecrr: 

- " ~aci::ity V g prr'r~3ss meeting specific State 

FenierL: : " .ritinci. srHTii^^res: 

. :. iper-'-^c ::v^.nent^ d::ze5 of implementation objectives 

sue s c d :taff, -u-^-me etc., are being met: [ 

4.3 Improvements have resulted in increased number of clients 

.served, placed,, referrals, etc.: [ 

5.0 Outreach/Commup.ity Impact 

5.1 Project recruits clients, as demonstrated by the number of 
persons entering project who would not otherwise be in the 

program as a proportion of program openings (waiting list?): ' 

5.2 Project retains client interest as demonstrated by number 
of applicants and enrollees as a proportion of program 

openings: 

5.3 Project is actively involved with at least referral 

sources: . - — 

• 5.4 Project personnel have had at least favorable media 

exposures: , — 

5.5 Project demonstrates potential to continue after termination . - 

of support: \ — 

5.6 Project demonstrates potential for project results to be 

effectively utilized after termination of support: 

5.7 Rehabilitation Division professional practices and standards 

can possibly be improved by project and its process: 

6.0 Project Relationships With Counselors 

6.1 Project Adds to Rehabilitation Process: 

6.1.2 Formal relationship exists for effective counselor 

« referrals to Project: 

6.1.3 Project provides adequate feedback to counselors 

on client progress: 

6.1.4 Project is responsive to Rehabilitation counselor 

suggestions: ' . 

INSTRUCTIONS: Sections 7 and 8 to be completed by Project Director. 

7.0 Project Self-Assessment 

7.1.1 If you had to "selV your project to someone, what would you say about 
it?" 
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7.1.2 What other specific resources would enhance your project's ability to 
serve clients and why? ^ ^ 



8.0 Exemplary Services ^ 

8.1 Give two case histories of clients who have especially benefited from the 
project. Please be as specific as possible, excluding names. 
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N 



9.0 ADDED CRITERION (please specify): ' ' -. 



The control group(s) for your project will be '"^ a^^j 

for comparison. " * ^^^ose items marked with an asterisk wil] be used 



Evaluation Comments: 
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STATE OF NEVADA 

DEPARTMENT OF HUMAN RESOURCES 

RALPH R. DiSIBlO. EO.D.. DircctOr 



DEL FROST. Administrator 

REHABIUITATION DIVISION 
ADMINISTRATIVE OFFICE 
kiNKEAD Building. Fifth floor 

505 EAST KING STREET 
STATE CAPITOL COMPLEX 
CARSON CITY. NEVADA 89710 



■ ROBERT LIST. Govcrnor 




Dear . 

In an effort to improve our services and to meet federal requirements for determining 
client satisfaction, we ask that you complete the attached survey questions and return the 
information to us WITHIN FIVE DAYS, Your answers will be kept confidential. 

The information on this sheet identifies you as a respondent to our survey. Please keep 
this sheet attached to the questionnaire . " 

— . Case # Bureau ^ . 

^■y/^^^'^ Not Rehabilitated ' office ' 

' Social Security Number ' Date of Closure 



Occupation at Closure(Code) Earnings (Wages) At Closure/Week 

Monthly Amount of Public Assistance ^t Closure Counselor 

Services Provided According To Clos/re Form' (Items Checked ) 

-Type of Service ^ \ Cost No ^ Cost & 



Provided or Arranged \ Only Cost No Cost 

: for by Agency ^ ' ^ (1) (2) (3) 

Diagnostic & Evaluation ~ ' ^ ^ 

Restoration (Physical or Mental) 



I College or University 

^ - Other Academic (Elementary or High School) 



Business School or College 
•r- Vocational School 

fd 



i- On-.the-Jo.b V 

Per'sona1>&. Vocational Adjustment 



Mi seel 1 aneous 

Maintenance (Example: Rent, Food. Etc.T 
Other Services 



Services to Other Family Members 
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.1 . Did you receive the services indicated (checked) on page one? Yes_ 
1.1 If "No," what services did you not receive? 



Ilo 



2. Is all other information on page one correct? 

2.1. If "No," please indicate v/hat is not correct. 



Yes 



No 



3. Were you satisfied with the services provided to you? 
3.1 If "No," please explain why you were not satisfied. 



Yes 



No 



4. Were there services you feel you needed, but did not receive? Yes__ 
4.1 If "Yes," please explain your other service needs. 



No 



5. How did our services help you? 



6. V/ould you recommend our services to a disabled friend? 

7. Do you wish to see a Rehabilitation counselor again? 
7.1 ir "Yes," what services do you feel you need? 



Yes_ 
Yes 



No_ 
No 



8. Were. you satisfied with the counselor's willingness to listen 
to your ideas while developing your rehabilitation plan? 



8.1 Comments 



V 



9. Were you satisfied with the amount and kind of information 
provided by your counselor about your disability? 



9.1 Conments 



Yes 



Yes 



No 



No 



10. V/ere you satisfied with how quickly you received services 

from your counselor and'others involved .in your rehabilitation 
plan? • Yes 



10. 1 Comments 



No 
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"N/A*" SERVICES MEHTIO.'JED IN QUESTIONS 11-14 TfiAJ YOU DID flOT RECEIVE, PLEASE WRITE 
11. Were you satisfied with the kind of training you received? Yes r.'o 



llo 



iIO^ 

I{0__ 
No 



Ko 



12. - Were you satisfied with the benefits you received from " ' 

training? ^ , 

13. Were you satisfied with the help you received* in seeking 
and oJ)taining h job? " 

14. Were ycu satisfied with the results of mental and/or 
physical restoration? Yes 

15. Are you working now? .j^ 

15. Were you working on •? Yes 

17. Are you a homemaker? (Working only in the hone with 

no wages) ' ' 

13. Are you retired? Yes 

19. What is your job title? . 

20. p What is your weekly salary (before deductions)? $ 

21. Do you receive any income from a government source' (For 
example, ADC; Social Security, etc.) yes 

21.1 If "Yes," what is the monthly amount? $ ^ 

22. If you are not working, are you looking for work? Yes 

23. If you are not working, how long have you been unemployed? 

Less than one month 4 to 5 months 

1 to three months 7 to 12 months ^ 

24. After you received rehabilitation services, have you been: 

J'^ostly Employed * f^ostly Unemployed 

24.1 If mostly unemployed, what do you feel has been the 
probl em? 



25. Did you receive help in completing this questionnaire*? Yes 
25.1 If "YES", was the person who helped you ..... CPlease check) 
A relative or friend 

Employer or l7ork Supervisor 

Vocational Rehabilitation Counselor 



No 



No 



nvf D'YS^^^^'' ^^^^'^ ^^'^ "^"^ ™ QUESTIONNAIRE IN THE ENCLOSED ENVELOPE WITHIN 



FIVE DAYS. 
THANK you: 

/ 



Name 
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ROBERT L. BRUNELLE 
COMMISSIONER 

NEAL D. ANpREW, JR. 
DEPUTY COMMISSIONER 




STATE OF NEW HAMPSHIRE 
DEPARTMENT OF EDUCATION 



DIVISION OF 
VOCATIONAL REHABILITATION 
' 105 Loudon Road Bldg. No. 3 
Concord, N.H. 03301 

271-3471 (603) 



April 23, 1981 



Susan Stoddard, Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 



Dear Ms. Stoddard: ' 

The N.H. Division of Vocational Rehabilitation currently depends 
on monthly computerized statistical printouts to identify aged cases for 
counsel ors'/supervisors' attention. When a case exceeds what we have 
identified as an acceptable period in a gfven status, that client's name, 
status and time in status would appear on the counselor's printout. 
Periodically, counselors must submit explanations for delays to their * 
supervisors. , < • 

Quality assurance is accomplished by-requiring supervisory review 
of each case at each of four points of process, eligibility, IWRP, closure 
and case expenditure. . 

Additionally, we have adapted the Assumption College Case Review 
Process and have just begun our second systematic case review. Our process 
requires supervisors to review a sample of status changes in each counselor 
caseload against C.R.P. requirements and standards as revised by N.H. 
In turn, a sample of this sample is reviewed by each, of three program 
directors. Finally, a designe of the Chief of the Division- selects a 
sample from cases reviewed by program directors. Resultis are compared 
and joint reports written which identify concern areas, possible reasons, 
possible solutions and plans for addressing the problem. 

Our first review identified a number of concerns that were addressed 
via training. Our second review is evaluating the effect training had on 
the problem. areas. 

I hope this is of some help in your research. 

Sincerely, 

5-^ 
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C; F. SavJysr 

LivEFREEORDiE PI anni ng & Eval uati On Specl al i st 

O Disability Knows No Race, Color, or National Origin - We Serve All of the Handicapped 

Equal Opportunity Employer • Equal Educational Opportunities 




JOHN J. HORN 
Cornmissioner 



St^vxe of- New Jei^sk^' 

DEPiVHTMEXT OF LaBOR AND INDUSTRY 
DIVISION OF VOCATIONAL REHABILITATION SERVICES 

LABOR AND INDUSTRY BUILDING 
TRENTON. NEW JERSEY 08625 

June 11, 1981 



GEORGE R. CHI2MADIA 
DIR EC TOR 

(609) 292-5987 



» Ms". Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

Ve dn New Jersey are very interested in your work on f.he new standards 
for vocational rehabilitation. The New Jersey general agency has, t\}e last 
two years, tTied<to address these standards. Ue are interested in both 
helping you and in receiving feedback from you on the development and 
measurement of these standards. ' , 

Your letter asks about two areas (quality assurance and case flagging) 
in which we are trying to develop efficient and effective systems. 

Since 1975 we have used a flagging system for cases over 90 days in 
status 02. Monthly, our counselors receive a print out CAppendix la) ar-. 
, ranged alphabetically , by status of all cases in their caseload. A copy of" 
this. print put is sent to the counselor's supervisor. Causes which, have 
'been in status 02 for over 90 days are narked by an asterisk. I7e have set 
as an acceptable upper standard, 30% of a caseload's 02 cases in status 
over 90 days. VJhen a caseload is over this limit for ^n unreasonable 
amount of time the ^supervisor and counselor should work together to de- 
te-rmirie the reason and solution for this situation. 

Besides the counselor print out, an office manager receives a monthly 
summary (Appendix lb) of an office's performance by caseload. This monthly 
summary lists each caseload' s statistics which includes the percentage of 
02 cases in status over 90 days. 

In the Fall of 1980 we began to periodically . look at the movement of 
cases in other statuses. About every six months we send to counselors and 
their supervisors* a list of cases in statuses 10 and 12 which have been in 
these statuses for over six months and those cases in these statuses for 
between three and six months. Also sent is a list of cases in statuses 14, 
16 and 18 .in status over four years. These cases should be reviewed by the 
. counselor and supervisor, and appropriate action taken. 

The other area mentioned in your letter, quality assurance, is also of 
vital concern to us. lie are in the process of developing and will pilot' 
test a systematic case review instrument (Appendix 2), based on the'critical 
questions from the San Diego ^^se Pveview Schedule. 

New Jersey Is An Equal Opporiunity Employer 

1 rr 
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•> ^ V June 11, 1981 

In trying to address the standards (Appendix 3) a number of questions 
have arisen. Most questions are .concerned with the method of measurement 
of a certain data element. For example Standard 4 data element ii asks 
for. a comparison o: the mean weekly salary of 26 closures at follow-up 
with that of the average worker in a given state. The State of New Jersey 
as well as the Bureau of Labor Statistics* calculates the mean weekly 
salary for only factory workers and not the general worker. This leads 
to a distortion of the comparison and an inability to really answer the 
question, . • • 

Other • questions are concerned with the validity of certain data 
elements. Far example standard 4 data, element iv asks for a "comparison 
of 26 closures with public assistance asaprimary source of support 
before ^nd after VR services." We question the validity of this data 
.element because we believe it does not show what was intended. It 
appears this data element was intended to. compare the number of clients 
receiving public assistance as their primary source. of support at the ^ . ' 

beginning of or during rehabilitation services with' the number receiving 
public assistance as the primary source of support at closure. Iloepfully, 
this number will be lower at closure than at referral or during service 
delivery. However, it may be better to compare public assistance at * 
closure with public assistance \t acceptance rather than at referral. 
At referral many people have SSI or SSDI cases pending, or may reach 
rehabilitation after being deinstitutionalized and not yet on general 
assistance. Also, at referral a counselor may not know if a client 
is receiving public assistance and update this information only after 
a client is in 02 status or later. 

These are examples of questions raised when we tried to address the 
standards. If you believe it appropriate, maybe one of our staff could 
share with you sone of the other problems we encountered in addressing the 
standards,. Or it mi£ .t be possible to work with one of the Model Evaluation 
Units to see how they are answering the standards. 

Ue will appreciate any feedback you can give us. 

Sincerely, 

George R.- Chizmadia, Director 
Vocational Rehabilitation Services 
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DEPARTMENT OF HUMAN SERVICES 
COMMISSION FOR 'tHE BU.ND AND V.SUALUY .(..PAIRED 

tlOO RAYMONP BOULEVARD 
NEWARK. NEW JERSEY O7102 
MRS. NORMA F. KRAJCZAR TELEPHONE 648 • 3233 
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May>, 1981 



Ms. Susan Stoddard 
Project Director 
3200 Adeline Street 
ierkeier, California 9u703 

Eear Ms. Stoddard: 

n 4.x^^ i-n-Hl <^ 1981. concerning; procedures 
T'-i- is in reroonse to your letter o. .-.p^ii . ^ cre^vic-^ 

1 -T.no -".lUv isourrnce Unit provides a quarterly count of all; • 
1. Tna -co^al-t./ lenr^^v, of tine in status for each 

client. Dalnys sre easily spotted ir. thin cour.t. 

■ .. . ro-f^uct G?=f> ^oviev.T, at least four {h) timss a year 

rrS-^I— ?1 . irlndioated. Plow Sheets ra-e cheolced and 
c"se ""^venent problems discussed during these reviews. 

■ - . — sS: sShoS ^i^^fp^BSi ■ 

Rc»viev: Process. 
Sfw -^e't^iSfJoeatiLl RehahiUtation Process. . 



efforts. If you havo an;i,' 
us 



^Sincerely, 




\ 




Nor, .r?. Xraodfear 



Mrs. Kor, 
Sxecuti\ Director 
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MEMORANDUM COMMISSION ^^R THE BLIND VISUALLY IMPAIRED 



DATE: - MAY 12, 1980 
•TO: ALL VR SUPERVISORS AND COUNSELORS ' - • 

. FROM: EDWARD GORCZYCA, ASSISTANT CHIEF, FIELD SERVICES 
SUBJECT: MOVEMENT OF CASES THROUGH THE VARIOUS STATUSES 



7/ 




This mficio'is issued to establish guidelines for the movement of cases through • 
the various" statuses in a timely manner. ... 

S TATUS 00 : New referrals should be contacted within .thirty (30) days from- the 
time counselor receives the case. ^ .^- 

STATUS 02 ;» A determination should be made to place client into 06, 10, or 08 
within a five (5) month period of time. 

STA'IUS- 10 : A determination should be made to place client intp a diagnostic 
program vithin a three (3) month period of time. 

STATUS 12 : ' A determination should be made to place client into status 14, 16, 
* or 18 vlthin a three (3) month .period of time beyond the projected 
date of init±ation of service as listed on the IVJKPr 

STATUS 16 : After c repletion of- service a contact memo should be subni-tted 
STATUS 18 : indicaniiig a status change. 

STATUS 22 : Sixty (5G) cays; a careful analysis should be made that all bills 
have b^sir passed for payment and the case* folder is in order for 
closurs^ . •. . • 

In all or the abava.- s^itrses ^ in order to account for flexibility and provide for 
the indlv.- tfr-pl n^^^-^^ cf^ :±ie client, if the specified.'-: time periods cannot be met^ 
a contHr:r meno srrrjcic be placed in the* case folder indj.cating the reason,* . 

. It was agreed upcn by both, supervisors and counselors that a minimum of four .C4} 
"case reviews per" 7ea:r voxild be- conducted.* \ ^*7ll.'--:' 



DEPUTY COMMISSIONER FOR 
VOCATIONAL REHABILITATION 



THE UNIVERSITY OF THE STATE OF NEW YORK 



THE STATE EDUCATION DEPARTMENT 

OFFICE OF VOCATIONAL REHABILITATION 
99 WASHINGTON AVENUE 
ALBANY. NEW YORK 12234 




May 6, 1981 



Ms, Susan Stoddard, Project Director' 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: : ' ' 

This is in reply to your letter dated April 6, 1981, requesting information 
on case flagging and quality assurance techniques used in New York State. 

In New York, flagging and quality assurance systems are combined. The 
procedure is computerized and a counselor "caseload report is produced each 
month. This printout is sent to supervising staff in Central Office, Regional 
and local offices, and each counselor receives his/her own copy. Cases 
remaining in certain statuses longer than allowed are flagged with an asterisk. 
These statuses are as follows: 

Asterisk- 



More than 3 months 
More than 6 months 
More than 6 months 
More than 12 months 
More than 12 months 
More than 3 ^mouths 
More than 6 months 

Statuses 06, 16, 18, 20 and 22 are initially monitored at the local office 
level. Periodic sampling reviews are conducted by the two Regional Offices 
staff, A copy of this printout is attached for your -information. Client and 
counselor names have been crossed out for reasons of confidentiality , j State and 
Area Office summaries are also enclosed for your review, A target of 10% has 
been established as an acceptable level for asterisked cases. 

I trust that these data satisfactorily answer your . inquiry , 

Sincerely yours , 

• /Basil Y.. Scott 

Deputy Commissioner 



Status 

• 00 

02 

10 

12 
- 14 - 

22 

24 




STATE OF NORTH CAROLINA 



JAMES B. HUNT. JR 
covcrnop 

SARAH T. MORROW. M D.. M P H. 

SCCRCTARV 



DEPARTMENT OF HUMAN RESOURCES 

DIVISION OF VOCATIONAL REHABILITATION SERVICES 
P. O. BOX 26053 

RALEIGH 27611 

April 21, 1981 



CLAUDE A. MYER 

DIRECTOR 



Ms. Susan Stoddard 

Project Director ' . 

Berkeley . Planning Associates 
3200 Adeline Street 

Berkeley, California 94703 ... 

Dear Sue: " . 

This is in response to your request to Mr. Myer for materials that we use 
..in **case flagging** (for undue delay) and other quality assuiance procedures. 

One of our best tools in helping counselors manage their caseloads is the 
client master list, which is distributed to each counselor carrying a case- 
load on a monthly b as is I am enclosing a copy of our manual material de- 
scribing this coipputer printout (master list) for your information. Please 
note that I have circled (in red) the explanations for items 27 and 33 for 
your attention, as these items relate specif ically to "c£ise flagging". 
Item 27 reflects the cumulative number of months that the client has re- 
mained in curnsSt^status . When a case has remained in Status 06 (extended 
evaluation) longer than the eighteen-month time' limit, an asterisk will 
appear in column 33. Also, an asterisk will appear in this column (33) for' 
any case in Status 00 - 2A when the client has remained in the status longer 
than the statewide average time period. 

Copies of the master list are also distributed to the Unit Managers and 
Quality Development S^pecialists for each caseload where they have responsibility. 
The client master list is an excellent tool for management study to determine 
,the progress of programs. . , ■ . . . 

Approximately, three years ago, we restructured our field organization in order 
to place increased emphasis on casework quality. We also revised and developed 
additional standards for casework. We included maximum time frames that a 
case should remain, in the various statuses and also strengthened ouf case 
recording requirements for each status. Enclosed are copies of our manual 
materials for Statuses 00 - 32 which* describe these expectations. 

Eleven casework'^ supervisor positions (formerly line managers) were restruc- 
tured to provide for additional casel^7ork review and quality control. These 



I 
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Ms . Susan Stoddard 
Page Two 
April 21, 1981 



individuals now function as Quality Development Specialists. In addition,, 
to their functions of monitoring, casework review, and other quality con- 
trol measures, they a.re also equally responsible for the developmental 
training of counselors, A functional analysis of these positions is en- 
closed to give you a detailed description, I am also enclpsing a copy of 
our *'case quality rating form", which is used in casework reviews performed 
by the Quality Development Specialists, Our field operations are geo- 
graphically divided into four regions, each headed by a Regional Director. 
Each region is further divided into units and facilities , with a total of 
31 unit offices and 7 facilities. The Quality Development Specialists- are 
responsible to the Regional Directors and have responsibility for several 
unit offices and vocational rehabilitation facilities (e,g, , mental hospital 
mental retardation centers, corrections, etc.), 

I hope this information and. the enclosed materials will benefit you in your 
exploration of quality assurance and case flagging approaches in our agency. 

Please let me know if we can be of further assistance. 



Sincerely, 




Bob H, Philbeck 
' ■ Deputy Director 

BHP/jb • . 

attachment * * 



CASE QUALITY RATING FORM 



CLIENT NAME"* 



COUNSELOR ' 



Instructions: The use of this casework rating system requires the reviewer 
to make subjective decisions. However, the structure of 
this system provides reviewers an opportunity to address the 
same issues in each case record reviewed. When items are . 
marked 0 or 3, the reviewer should record specific reasons 
for the rating in the Comments Section. 

INTAKE AND PROGRAM DEVELOPMENT ITEMS 

PI Timeliness of Services and Case Management 

(Review R-IA entries, referral record, mesterlist, etc., to determine^ 
timeliness of VR actions. Judgement is necessary to determine if 
case entries represent purposeful efforts to maintain case continuity.) 

(3) Usually means client was interviewed within 15 cays 

of referral' and there was no unexplained gaps in . 
services of over 30 days up through program 
development. 

\ (2) .Usually means client was intervi2v;ed within 30 days 

of referral and services were provided with no 
unexplained gaps of 30 days or mc^e. 
Delays or lack of contact were adequately explained 
or unavoidable. 

\\ ( 1 ) Usually means client was interviewed within 45 days 

and services proceeded with no unexplained gaps of 
•« 30_ days or more. 

. (0) Usually means there was a delay of over 60 days 

between referral and client interview or client was 
never interviewed. 

Or there were unexplained gaps in case activity of 
oVer 30 days. 

...... \ . • 

Comments: . 



Client Contact - Personal Interviews with Clitnt 



(Review CPR entries. The item assumes that some personal interviews 
with the applicant should be made and the norm would be one at the. 
time of application for services .and at least one at the time the 
program is developed. A single interview at application may result 
in ill-conceived plans.) 



(3) Usually 3^ or more client interviews, or 
interviews with examples of extra effort 
(home visits, contact and discuss with other 
professionals or other family members, previous 
employers, or referral sources, etc.) 

(2) Usually 2^ interviews; 1_ at intake and 1_ for 
planning. 

May be 1_ interview for rapid action case. 

(1) Usually J_ interview, or more than 1_ interview, 
but time between interviews limited continuity 
of case. 

(0) No interviews, or so meaningless that planning 
could not transpire. 



Comments: 




P3. Rehabilitation Diagnosis 



(Review R-4, CPR notes, and client information documents included 
in the case record.) 

(3) Rehabilitation diagnosis indicates comprehensive 

investigation, analysis, and synthesis of data. 
The client's stated interest, scholastic perfor- - 
mance, hobbies, work history, ratings on educational 
and vocational guidance tests, medical information 
and psychological dynamics were appropriately 
utilized in determining the vocational direction and 
goals of the client. Eligibility is clearly and 
efficiently established, demonstrating good use of, 
diagnostic materials. Client involvement is obvious 
and well documented. . . ' ' " 

(2) Rehabilitation diagnosis is adequate. Client's stated 

interest, scholastic performance, hobbiesjwork history, 
medical information, psychological dynamics and atti- 
tudes towards work were explored and considered in 
establishing the vocational direction and goals. 
Eligibility statement is adequate and client is clearly 
eligible. Client involvement is adequate, 

(1) Rehabilitation diagnosis may be appropriate. Diagnostic 

materials were utilized minimally to establish vocational 
direction and goals or goals were established based on 
the idea the client will return to his former job with- 
out thought to possible need for occupational change. 
Client is probably eligible, but diagnostic materials 
are of marginal quality or eligibility statement is^ 
not conclusive. 

(0) No documentation of rehabilitation diagnosis— no 

rationale stated or apparent for the vocational 
direction or rehabilitation goals established. No 
client involvement apparent. 



Comments: 
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Rehabilitation Program 

(Review Program, diagnostic data, CPR entries, and application form 
as needed.) 

(3) Vocational goal is clearly appropriate. 

Is clearly compatible. with client's disability. 
Is clearly compatible with client's interests and 
other client data as shown in diagnostic material 
incl uding vocational assessmento 
Planned services appear to be very appropriate. 
Services appear to meet client problems as stated 
in application and diagnostic materials. 
Program is specific regarding services to be provided: 
(a) what services, (b) the source for services, 
. (c) when services are to be provided, (d) VRS 
contacts with client during services, (e) placement 
plan, and (f) client participation, (g) May have 
evidence of extra activities such as attempts to 
obtain services at no cost to agency, etc. ' 

(2) Vocational Goal is appropriate. 

Is compatible with client's disability and all 
diagnostic materials. 

Planned services appear to be appropriate. 
Services appear to meet all major client problems. 
Program is complete regarding items (a) to (g) above 

(1) Vocational Goal is probably appropriate but questions 

may' be raised. 

Compatibility with disability may not be clear. 
Rationale for Vocational Goal is questioned. 
Planned services are probably appropriate but are , 
questioned in or more areas. 

May not address all client problems or fail to show 

how services will nieet.,client problems. 

Is vague in addressing items (a) to (g) above. 

(0) Vocational Goal is not compatible with client's 

disability, or is believed not feasible for client. 
Vocational Goal conflicts with diagnostic reports. 
Planned services do not appear appropriate. 
Program fails to address significant client problems, 
or shows little apparent benefit to client. 
Program fails to address major items in (a) to 
(g) above. 



Comments: 
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Other Factors in Case Intake and Planning 

(Includes any events or factors not reflected in Items P1-P5, i.e., 
issues to be considered are feedback to referral sources, degree 
to which R-4 and NCR-13 are completed, use of agency medical consultant, 
appropriateness of certificate of eligibility or ineligibility, appro- 
priateness of TF/SF certification, evidence of client involvement in 
eligibility determination, etc.) A combination of numerous deficiencies 
should result in a rating of 01 When items are marked 3, 1, or 0, the 
reviewer should record specific reasons; for the rating in the coiments 
section.) 

; (3) Case includes examples of exemplary case management 

not shown in Items 1-5. 

(2) Case has no examples of notable "other" factors. 

(1) Case has deficiencies not previously indicated. 

(0) Case, shows critical errors not previously indicated. 

Examples: Program might appear to be the work of 
the counselor without any input from client, or may 
appear to reflect events already transpired. 



Comments: 



SERVICE DELIVERY 

Dl . Service Delivery Prior to Placement and Follow-up 

Primarily determined by review of IWRP, Addendums and CPR entries. 

(3) All planned services provided to date with 

examples of extra effort to meet client needs. 
.(Intervention for client, very prompt services.) 

(2) All planned service provided to date in a timely 

manner. (Usually means no unexplained gaps in 
case activity. ) 

(1) All planned services provided to date but with 

apparent unexplained delays or lack of client 
contact. Planning incongruent with diagnostic 
data. (Usually means unexplained gaps in case 
activity). Little casework activity including 
minimal counselor-client involvement. 

' (0) Undue delays in provision of services. , 

(Usually means unexplained gaps in case activity.) 
Some planned services never provided or obvious 
client needs not addressed. 

Comments: 
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Program Addendums 

(including amendments ^ annual review, ineligibility reviews, etc.) 

^ (3) Program reviews and appropriate addendums are 

timely and made as result of joint client-counselor 
action in response to new circumstances. May re- 
present extra counselor effort to influence client 
into a more appropriate goal. . 

(2) Program review and appropriate addendums completed 

with maximum client involvement in a timely manner. 
Program reviews and appropriate changes include 
appropriate goals for client and follow for the 
original program. There is evidence of agreement 
between client and counselor before action is 
taken. 

_(1) Program review and appropriate addendums completed 

with client involvement. Program changes were 
made to accoinnodate client actions without counselor 
influence, or were made by counselor with little 
input from client. Tended to reflect events rather 
than plan ahead. Example: client obtains job 
difference from original program before program change 
made. 

(0) Program review and appropriate addendums cbmpleted 

with minimal client involvement. Program changes 
may include inappropriate employment objective and/or 
inadequate or inappropriate services to client. » 



Comments: 
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Placement Services 



This item focuses on the planning and provison of services to 
prepare a client for work and to assist him in obtaining appropriate 
employment. This includes development of client attitudes consistent 
with the job environment and reconciling problems or barriers stemming 
from the milieu outside the client. There are numerous ways a 
counselor can be directly and integrally involved in job placement 
with a client, i.e. direct contact with employers, collaboration with 
other placement agents, task analysis and job modifications^ etc. 

Job readiness activities would include such items as providing infor- 
mation related to employment during client assessment and IWRP development, 
individual and group instruction of clients in job seeking and retention 
skills, personal assistance in preparing for job interview, etc. 

(3) VRS made direction employer contacts in client's 

behalf as needed and engaged .in job readiness, 
activities as appropriate.- (May be marked even 
if cl ient outcome was unsuccessful.) 

(2) VRS provided appropriate job readiness activities; 

routine referral to other placement agents, or no 
placement was needed. (May be marked even if 
client outcome was unsuccessful.) 

(1 ) Client was available for employment for over 30_ 

days without VRS effort. 

Cl ient obtained job but in inappropriate work. 
Less than desirable outcome in case, possibly due 
to lack of VRS involvement. 

Assisted with minimal job readiness activities - ' 

(0) Client was available for employment for over 60 days 

with no VRS effort to provide assistance. VRS assisted * 
with inappropriate employment or inappropriate outcome 
resulted possibly due to lack cf VRS involvement. Did 
not provide job readiness activities. • • 

Comments: 
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Follow-up Services - After Placement 



Follow-up services may be incomplete at the point in time this item 
IS reviewed. The Quality Development Specialist will review the 
Item in light of what has transpired and make a judgment accordingly. 

^(3) VRS followed case after job placement. for 3 

or more purposeful client contacts and over 
60 days. The counselor may also show extra 
effort by contactin.i employers, etc. 

(2) VRS followed case after job placement for 

60 days and made at least one purposeful 
direct client contact to assure satisfaction 
with job. 



_(1) VRS confirmed employment but not directly with 
client. There were long intervals in follow-up 
without contact with the client or employment sources, 

_(0) VRS closed case without 60 days follow-up, or with ' 
no evidence of contact with client after Placement. ' 



Comments: 
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other Factors in Service Delivery 



(Includes any events or factors not reflected in Items D1-D4. 
Factors to be considered are the adequacy of CPR notes, evidence . 
that counseling was provided and ^that services were provided 
within a counseling relationship, authorizations, status changes, 
masterlist utilization, maintenance arrangements, PES, timely and 
proper bill processing, timely and proper correspondence and 
telephone response, other available resources and services utilized 
were in a timely and proper manner, evidence that significant 
services were prbvided and that VR services contributed to the 
client's rehabilitation, adequate closure summary, order or case 
record materials, non-independent casework showed appropriate counter 
signature and feedback to referral source. When items are marked 3, 
1, or 0, the reviev/er should record specific reasons for the rating 
in the comments section. 

(3) tase includes examples of exemplary case management 

not shown in IteTtis D1-D4'. 

(^) Case has no examples of notable "other" factors. 

(1) Case has deficiencies not previously indicated 

in items D1-D4. 

(0) Case shows critical errors hot^previously indicated 

in items D1-D4. 



Comments: 
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OUTCOMES 



01 . Achievement of Goal 

. .(3) Achieved occupation stated in original or amended 

program, (may be in competitive, sheltered, 
homemaker or homebound status). 

(2) Achieved occupational level stated in an original 

or amended program. 

(1) Achieved rehabilitation, even if incompatible with 

clients disabling condition and if appropriate 
counseling was provided. 

(0) Did not achieve rehabilitation. 

Comments: 



/ 
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(3) Sheltered or unemployed to competitive employment 
status, 

(2) Student not working, or underempi /ed, to competitive 
employment status or student not working or unemploy- 
ed to sheltered, 

(1) No change in employment status but rehabilitated 
(includes homemakers and homebound). 

r 

(0) No change in employment status. Not rehabilitated. 



Comments: 



N 

03 . Innedse in Weekly-E'irnintjS . 

(3) Over $200 per week 

_^ (2) $101 to $200 per week ' 

1) ; i to .$100 per w. 'Vc , turns to '■-me wage 

(0) None 

Comments: 
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DIRECTOR 



SARAH T. MORROW, M.D., MPH . 



piy To:. 



April 23, 1981 



Ms. Susan Stoddard 

Project Director •: 
Berkeley Planning Associates 
3200 Adeline Street 

Berkeley, California 9^703 - ■ ' 

Dear Ms. Stoddard: 

As requested in your letter of, April 6, attached is information 
concerning our agency's case flagging and quality assurance. ■ 

We hope you will find this information useful. If you have 
any questions, please contact Jack Scott at (919) 733«A231. 




LEJjnSA 



Attachment 



cc: Mr. George B. Staton 
Mr. Jesse L. Sherrill 
Mr. Jaclc C. Scott 
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N. C. DIVISION OF SERVICES FOR THE BLIND 
P. 0. BOX ?658 
RALEIGH, N, C. 27602 



I. Case Flagging 

The agency master list of referrals, applicants, and 
clients is computerized. Included in the data items on each 
client is "Months in Current Status." The system is prograinmed 
to "star" the following statuses after three months: 00, 02, 
10, 12, 20, 22, and 2A. Also status 06 js starred after 15 
months. This flagging procedure enables the counselors • to . 
quickly review their master lists to identify possible undue 
delay in status. ^ 

In addition to the above, a summary of the nunber cf 
flagged cases for each counselor is provided to each supervisor. 

II. Quality Assurance 

Quality assurance in this, agency is carried out thrcugh several 
procedures, controls', and monitoring. Among these are: 

(A) Review by supervisor of all acceptances, rejections, 
and closures. 

(B) Supervisor's review and approval of all IWRPs, 

(C) Periodic review of sample cases by the Deputy Chiefs 
of Rehabilitation Services. 

(D) Review and analysis of computer caseload summaries on 
a quarterly oasis. 

(E) Establishment of goals and objectives into tlie V/P/PR 
(V/ork Planning/Performance Review) of each counselor 
and supervisor. 

(F) Federal evaluation standards reports and .special 
evaluation projects and studies. ' 

I 

♦ v: I 

1 
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ADMIMSTKATIVU Oi riCU 



DIVISION OF VOCATIONAL REHABILITATION 



VOICE PHONE 701-224.2907 



T.T.V. 701-224.2699 

May 14, 1981 





i;s . Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street • 
Berkeley, California 94703 

Dear Ms . Stoddard: 

Please excuse the delay in responding to your request for material used 
for case fl agoing and quality assurance. 

Each month the office supervisor receives a "counselor-masterlist" which 
shows, among other things, the number of months the-client has been in 
the status. If. the clienr has been in a status for longer than the 
suggested guidelines and the supervisor is not aware of the reasons for'"' 
this, the individual client line on the counselor masterlist is 
highlighted with a marker. The supervisor then meets with the counselor • 
to establish what would be an appropriate^ plan of. action for the 
counselor to complete to assist the client's movement through the 
statuses. A date for the completion of the planned action is establ ished 
and the case is again reviewed by the supervisor on that date. 

The guidelines for status life are as follows: Status 00-1 month; 
Status 02-6 months; Status 10-2 months; Status 12-2 months; Statuses 14, 
16, 18-1 year; Status 20-3 months; Status 22-4 months; and Status 24- 
2 months . . , 

The counselor masterlist also identifies with an asterisk any client who 
has an I.W.R.P. due date within thirty (30) days of the printout . 

In the quality assurance area, each counselor's supervisor is' responsible 
to complete a 10% random sample of the counselor's casework each quarter. 
Results of the case review are //ritten and discussed with the counselor 
and a copy is submitted to the office administrator. There is also an 
annual case review which randomly selects 10% of the regional offices 
caseload. This review is done by representatives from the State Office of 
Rehabilitation Services. In conjunction with this review, the SSA/VR 
Program is reviewed for compliance with the repulations. 

If you would have any further questions or vjou'ld like additional information, 
please contact us . 




Director 
Rehabil i tation* Services 
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^^ pw-</ State of Ohio 

iP^^C Rehabilitation Services Commission 

VJn -/* " '"<<J'nat«onal Year of DisaDicd Pcfsons 

ADMINISTRATOR >«L^ v/y^/ 

Cooper Sontag sJ^^-'Nj' ^^^^ 



O-l 



COMMISSIONERS 




David E, Tilton 
Chairman 

Warner E. Brightman Jacqueline F, Giles 
Boggs Hargrave Mann Robert H, Saravalll 
Jack F. Stewart Denver L White 



liay 26, 1981 



Ms. Susan Stoddard, Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

Enclosed are copies of various monitoring reports and agency guides that 
relate to time-in-sta tus , etc. 

Sorry it took so long for me to respond. If you have any questions, feel 
free to contact me at (614) 438-1302. - 



Sincerely, 




Dennis Wysocki 
Program Evaluator 

Division of Planning and Evaluation 



Enclosure 
DW/gb 
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<i ■ ■ ■ 

STATISTICAUliPORTS • 



Nanc of Re pore 


I'rttqujncy of Report 


Level of Production 


Report Content 


Major Uses of Heport. 


Master List of 
Cases 


■f'loiittily-produced on infor- 
mation received at Central 
utrice through last day of 
tiic^ month 


Caseload - Copy sent to 
each area supervisor, each 
rehab supervisor, and two 
to each office 


Lists all open 
cases on the case- 
load and cases 
closed during the 
current quarter ' 


A resource tool that indicates: 
clients by status, number of ' 
months in that status, cases 
needing annual review, and 
specific client characteristic 
information 


Manageneiit 

Inforiiiation 
Rcnorr 


Monthly-produced on infor- 
mation received at Central 
Uitice through last day of 
the month' 


Caseload, with team, group, 
district and State sum- 
maries- Copy sent to 
each area supervisor, each 
rehab supervisor, and each 
office 


Cumraulative statis- 
tics, Current 
fiscal year cases 
broken down by spe- 
cial groups ^ 


Monitors activity by special 
group. Monitors caseload move- 
raent, balance. Provides curiyiiu- 
lative statistics for fiscal 
year, and certain caseload ■ 
management measures 


New Referral = 
Report 


[■loiithly-produced on infor- 
mation received at Central 
Office through last day of 
the month 


Group with District and 
.State Summaries - Copy 
.sent to area offices, and 
rehab supervisors • 


Current fiscal year 
referrals by refer-, 
ral source and month 
i\'ote: Uses referral 
date not date the 
referral was pro- 
cessed 


Monitors new referrals by month 
for each referral source 


Thernistats 


Quarterly 


District and State. , 
Other breakdowns available 
upon request. At present 
time copies sent only to ' 
select BVR districts 


Provides special 
information on 
clients by status. 


Provides special information on 
groups of clients 


Time in Status . 
Report 
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Quarterly 


Caseload - Copy sent to 
area supervisor and each 
office 


Shows number clients 
in 00, 02 and 10 for 
lonc neriods of timn 
and length of stay 
for clients current- 
ly in each status 


Lists clients in status 00, 02 
or' 10 for 10 months or more. ' 
oiiows current average length of 
stay in each status, 
Monitors" case movement delays. 
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Caseload Management Guides 



Caseload distribution guides: 



Sus^^ested 



RSC-FY78 
Actual 



Referral, applicant, extended eval. statuses 




51? 


Active Statuses • 






of active caseload: 






Statuses 10 and 12 


13-17% 


11% 


Statuses 1^1 


6- 8% 


6% 


Statuses 16 - 


9-15% 


10% 


Statuses 18 


30-40% 


46% 


Statuses 20 , > 


8-10% 


8% 


Statuses 22 


12-14% 


12% 


Statuses 2k - 


9-10% 


7% 



Months in status guides: 



Desired Average 



status 


.. Months 


00 


1.0' 


02 


3.0^^ 


06 


9.0 


10 


1.0 - 


12 


1.0 


m 


4.0 


16 


4.0 


18 


10.0 


20 


2.0 


22 


2.0 


24 


2.0 



_4=.5_mos-. 
avg. 



15 mos. 
avg. 



Maxiaun Limits 
Months 



2.0. 

_J1..0_ 
18.0 



2.,0 
, 4.0. 
12.0 
12.0 
48.0 
4.0 
4.0 
12.0 



26's 
FY-78 



0.9 n 
6.8 J 
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OHIO BURJu\U OF VOCATIONc'iL REELVSILITATIOM 
Effective Caseload CharcicCariscics and Accomplishtn'nnt 



0-/ 



PREFERRED MIN'IML^t CASELOAD SIZE - ALL STATUS 

VRC - 1 - 100 
VRC - 2 - 125 



CASELOAD STATUS DISTRIBUTION 



22Z ~ hTA 


58% - 68% 


00-02-06 


10 thru 24 



(00) - 1 mo. 


(02) - 3 mo. 


(10) 1-2 mo. 







Total should not exceed 4 no. average, 00 thru 10, 
BVR C0L'?>SEL0R EXPECTATIONS - COMPLETED REHABILITATIONS 



VRC I 



VRC II 



MARGINAL ' AVERAGE ABOVE EXCEPTIONAL 

AVERAGE 



25 



26 - 29 30 ^ 34 35 or more 



29 



30 - 34 35 - 39 40 or more 



SE\^RELY DISABLED R£H/iBILITATIONS 
(General caseload) 



VRC I, II 



0 



MARGINAL 



44% 



7V/; 



AVERAGE ; ABOVE 
! AVERAGE 



45 - 54% 



I' 



55 - 59% 



/exceptional 

60%+ 
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BVR Group/Team Performance Model 
Fiscal Year 1980 



RST 



Quarter 



1 . Rehabs/Caseload 



Group/ 

Team 
Average 



Bureau 
Average 
For Qtr. 



Group/ 
Team 

Average 
FY-79 



Group/ 
Team 
Hi-Perf , 
FY- 7 9 



2. Tot. Closure Cost/Rehab 



3. Applicant Rehab Rate 



4. Accepted Rehab Rate 



5. Average Caseload Size 



6.. Caseload Distribution - % Active 



7. Numb^'r of cases, 00 over 3 mos. 



8. Number of cases, 02 over 3 mos. 



'9. Number of cases, 10 over 3 mos. 



10. Percent ^rehabs SD 



Key: 1. Your group or *team average for Quarter 

2. Self-explanatory • 

3. Your team or group average for FY79 

*A. Statewide group or team high performance for 
FY79. individually for each category. 



ERLC 



182 




STATE OF OKLAHOMA 
OKLAHOMA PUBLIC WELFARE COMMISSION 

DEPARTMENT OF INSTITUTIONS, SOCIAL AND REHABILITATIVE SERVICFS 

(Department of Public Welfare) , ^ 

L. E. Radcr 

Director of Public V'clfare , , 

Sequoyah Memorial Office Building 

Mailing Address: P.O. Box 25352 OKLAHOMA CITY, OKLAHOMA - 73125 

In Reply - Address lo Director- 

' April 17, 1981 Attention: Lowell E. Green 

Executive Assistan: 



Susan Stoddard , 
Project Director 

Berkeley Planning Associates * 
3200 Adeline Street 

Berkeley, California 94703 ^ 
Dear Ms, Stoddard: 

In response to the request made in your letter of April 6, 1981, we are 
enclosing copies of several of our forms or documents broadly related 
to quality assurance and case flagging. 

Here are brief explanations of each:- 



1- ^SR901 is generated monthly to inform area supervisors regarding 
counselors who need to make Program/ Economic Need Reviews with 
their clients. An individual message for each overdue review 
is generated for the counselor. The message is repeated each 
month until the review takes. place and the counselor updates 
Block 205 of the RVS 105R. 

2. RVS 105R IS the basic data processing document jLiS-^d;^xy^*I^g:^a,"*>^'*^*^ 
bilitative and'^ Visual^Ser^ices^^^^^kJS^ 

§.nd.Ajg^-M^ every rehabilitation 

^^?^^^^^^S¥rice~ In the state. 

3. This is, a portion of the Agency^-Form Guide which deals with 
edits exception messages, and tim^e^;:;in'- status limits. 

4. FR205 is a master list generated for eac^counselor every 

month. Overtime is indicated in the far rigl"f^Qh and column, - \.^, 

and summary data are tabulated at the end of eafch. counselor ' s 
master list. 
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Susan Stoddard 



2 



April 17, 1981 



5. This packet includes copies of the Case Review Worksheet with n 
Instructions and an explanation 'of case selection procedures. 

This form is used by review teams headed by personnel from the 
Program Evaluation Section of the Program Development Unit, 
State Office, Team members inc|lude one representative from 
each of the four administrative areas of the state. This 
review is made ou each caseload every two years. 

6. VR-C-55 (with instructions). This form is used by area supervisors 
for review of cases within th^ir units and is used annually for 
each, caseload . ^ 

We hope the management information enclosed will be of help to. you. If 
you desire further information or if you have any questions, please 
contact Gerald S; Rosecrants, Program Evaluation Supervisor, Rehabilitative 
Services #24, State Office, P.O. Box 25352, Oklahoma City, Oklahoma 73125, 
phone (405) 424-4311, extension 2322. 



Very truly yours','" 
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CASE REVIEW WORKSHEET 



Client Nane 



Dace_ 
Cslr. 
Case # - 



CsU 



Status ■ 



N 



. 1., 

2. 

3. 

4. 

5. 
"6. 

7. 

8. 

9. 
10. 
11. 
12. 



13. 
14. 
15. 



Medical information adequate and current at acceptance 
Primary and Secondary Disability correctly coded 
Severe Disability., status correctly coded 
VR-C-IS describes .vocational limitations 
Intermediate objectives identified on VR-C-5 
All services identified on VR-C-5 

Appropriate information listed for each service shown on VR-C-5 
Reverse side of VR-C-5 complete 

Was consideration of similar benefits documented 

Was rWRP reviewed with the client as needed 

Financial need determination correct and reviewed as needed 

Vocational objective realistic and compatible with disability ~~ 

Have authorization cancellations and -changes— been- kept""current 

Sufficient and timely contact maintained with client 
Is client currently in a Co-op High School Work Study Program 
16. Is lEP and IWRP coordination documented 
■ 17. Are Teacher Coordinator contacts documented 

18. Is student/client currently employed or in training 



19. If closed as a Homemaker, was that the original vocational objective 

20. Were training costs provided with VR funds 

21. If training was. provided, was it related, to occupation at closure 

22. VR-C-5B proparly completed _ — 



1, 

.- 

_ 2. 

- 3. 
_ 4. 

_- 5 . 

_ 6- 
_ 7. 

_ 8. 

_ 9. 

_10. 

_11. 

_12. 

;;i3': 

_14. 

Is: 

_17. 
18-. 



_19. 
_20. 

22. 



23. VR-C-5C properly conpleted. 



23. 



0 
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CASE REVIEW WORKSHEET INSTRUCTIONS 

Items 1 through' IS are to be checked on all active cases. Itcins 1 through 22 are to be 
cl'.ecked on cases- in statuses 26, 32 and 33. Iten 23 is to be checked on cases in statuses 
OS, 2S and 30. 

1. If all medical conditions were not inve.s t iga t ed , check "NO" unless the reason is 
adequately justified in the recording. .If medical reports were used in lieu of new 
e>;aninac ions (both general and specialist), check "NO" unless they contain adebuale 
inf cnr.ation and/orj are not more than si>: months old.* (See CWM 2220.2, 2220.5) 

2. Check the codes in Blocks 228 and-.231 to make sure that the code is consistent with 
the description of the disability. If the disabilities are not described correctly on 

. the 105R, (Blks 227 & 230) this item may be checked "YES" but a con:nent should be made 
on the form to draw the incorrect description to the counselor's attention. Coiriment 
should also be made if, in the reviewer's opinion, the primary and secondary conditions 
hr.ve been reversed. 

3. See, 105R Form Guide Instructions, page 51-59 for coding instructions. If there is 
evidence in the recorci to indicate that the case could be coded as severely disabled 
but the counselor has failed to do so, chec.< this item "NO" and coTTjnent accordingly. 
In some cases the disability description or disability code may be incorrect which 
might affect the coding of the severe disability status. In situations such as this, 
make your judgement on the basis of the correct disability code. 

A. The specific vocational activities the client can not perform due to his disability 
should be referenced e.g., " Jobs which require dealing iwith people , frequent change , 
responsibility for others , repetitive tasks , bending , walking , etc. A list of specific 
occupations should be checked as "NO" unless there are a sufficient number of them listt 
tc demonstrate that a substantial employment handicap exists. 

5. Form Guide VR-C-5 instructions. (CIn'M 2272.8) 



"~6". A"ll~'se'rvi^c3s* plann"ed and/or provided must be shown on the VR-C-5 . Check against autho- 
risations and 105R planned costs. If any discrepancies between VR-C-5, authorizations 
cr 105R planned cos t^;-, are evident , check "NO" and comment as to the disci epancy . Diagnc 
sis and eva lu,at ion 's ervi ces are not required to be shown on the VR-C-5 if no extended 
... ev^lua^ibn p'rogram was written. (Form Guide VR-C-5 instructions) 

7. Check for evaluation criteria, provider^ rates, when appropriate and beginning and end- 
ing dates on each service shown on the VR-C-3. (Form Guide VR-C-5 instructions, CWM 
2272.8) Do not check "NO" on this item for any service not shown and for which v6 was 
marked "NO". 

8. Ch^cK review schedule (if IWRP services do not. extend beyond 12 months, review schedule 
may be blank), client views (counselor views are optional), and appropriate signatures 
and dates. (FG VR-C-5 instructions, Qn*^! 2272.8) 

9. Similar benefits documentation can be on the VR-C-5, or other narrative recording. 
(CWM 2236.1/ 22A5.6, 2201) 

10. Check for documentation to show the client was given an opportunity to review the IWRP 

at least once a year and that if the client decliiies the review, this fact is documented 
Cases in 06 must be reviewed every 90 days, but do not necessarily have to be done v:ith 
the client . - . ' * • (CU^M 2236.2, 

2272.3, 2272.8, 2274 . 1 , 227A . 3 , Form Guide 105R. instructions , pp A-7) 
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11. Is inf ormatiion on VR-C-36 complete, current and consistent with other case record infor- 
mation. Was financial need determination nade each tine client's financial situation 
changed if client is shown to be in economic need and was a review conducted at least 
annually. If services based upon Economic Need were not provided or planned, ma^k thi.s 
item "NA". --^ • ' 

12. If, in your judgement, the vocational objective, is unrealistic, check the item "KO". 

13. Look through outfitanding authorisation folder for authorizations on the case being 
reviewed. Check dates and case recording. If authorization appears to be in need of 
cancellation or liquidation, draw it to the counselor's attention in comments. If it 
definitely needs to have been liquidated^ cancelled, 6r changed mark "NO" and identify 
the authorizationC s ) in a comment. (RVS Memo 80-46) \ 

]A. Was client contacted when there was any indication of a need for it? 

j 

15. If client is not currently in one of the Co-op High School Programs, check "NO" and 
leave ??15, 16, 17 blank. Check for coding in Blocks 16|8 and 170. 

16. Individualized Education Program (lEP) and IWRP coordin'ation is evidenced by C-11 re- • 
cording, IWR? or program summary recording or inclusion of the lEP in the VR case record 

17. If there is not at least one contact report per semester by the Teacher Coordinator, 
check ".NO". 1 " : 



IS. 



If student/client is not working or in a training program outside of the school class- 
room at the time of the last recorded contact, check "NOV (unless the last recorded 
contact was in the summer or between semesters in which dase make determination of work- 
ing status on basis of previous semester.) \ 



19. Self explanatory. ^ 

20. Training costs include any expenditures associated with a client's training whether or 
-not the actual' tiTitibn was paid by the agency, e.g. tuition, ^oqks and supplies-, mainte- 
nance and/or transport at ion associated with training, training fees, etc. If not pro- 
vided or if provided at "No Cost", check "NO". 

21. If training was not provided or it was provided with none of the costs identified in 
item 7, mark "NA" . The determination of relatedness is to be made on the basis of 
course content and the type of work activities, in which the client is engaged. Do not 
make a determination solely on the basis of what has been said in the closing summary. 
Verify it from the record. 

22,. Check for completeness and accuracy of the form and adequacy of counselor's explanation / 
iis tc suitability of employment . Check dates of supervisor's signature with effective 
c'ate of the 105R document (Blk 111) that moved *case to Staitus 26. (FG vr-C-5B instruc-/ 
. tionc, G':m 2272.17 (3). ' / 

If case v:as closed in Status 26 prior to 2/81, check the VR-C~11 closing :5ummary to see 
if it contains statements as to the services* that were provided, the suitability of the 
"--"client's employment, the employer *s name and address, and an analysis of how the seryiccs 
contributed t.o the client's employment, .Mso check dates of supervisor's and counselor's 
signature with effective date of the 105R document (Blk 111) that moved case to statu.s 2t 

23. Check for proper des ignaticn . of reason for closure on the VR-C-5C and the 105R (31k 110), 
adequate documentation of reason for closure, client ' s- views and date of annual review 
when case is closed due to ineligibility. 
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PROCEDURES FOR -SELECTIIJG CASES TO BE REVIEV.'ED 

i 

Cases for review vill be selected . f von a printout containing the cases 
on each caseload being reviewed and their status as they were at the end 
of the nonch preceding the review. The printout will contain all 'active 
cases above status 10 and chose in 06, all cases in status 26-33 and cases 
in statuses OS ( except 00 to OS), 2S and 30 closed after 2/Sl;^ 

The cases on the printout v)ill be randomly selected according to the 
following stratification scheme. 



STATUS 



06. 
12 

16 
18 
20 
22 
24 
08 
2.6 
28 
32 



NO. OF 

CASES \ 



1 
1 
1 
2 
3 
1 
2 
1 
3 
6 
3 
1 



25 • 

If there are not enough cases on the caseload in any one of the active 
statuses (06, 12-2A), additional cases will be evenly selected frcin statuses 
16 and 18 in the order of preference. 

If there aren't enough cases on the caseload in statuses 08 or 28, select 
additional cases from the other status (OS or 28) if there are still not 
enough, select additional cases frorn status 26. 

If there ar- not enough cases in status 32 or 26, select from the other 
(26 or 32). The next order to select frcn if there are not enough 26's 
or 32's should be statuses 22, 20, 16 in that order of preference. 
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'!' \: • STATE OF 0}a.AHO^L^ ^ C/** 

DEPARTMENT OF INSTITUTIONS, SOCIAL ^aN'D REHABILmTIVE SERVICES 

WORKSHEET FOR CASE REVIEW 

COU:-.^SELOR CLIEN T [ ' _STATUS DATE 

YES ]iO NA PRELIVjlNAKY IN^^ESTIGATION ^ I 

• ' ? 

Survey form complete and cignificsnt information securing during the initial- > 

interview. *" 

: It 

Prompt follow through on referral. If no, explain. 



Adequate diagnostic workup. If no, explain. 



Adequate vocational ^testing. If no,- explain, 



5. Record reveals client advised or rights under Title VI. 

CASE EVALUATION ci PIA.KNING 

6. Eligibility adequately established (disability, limitation, vocational 

handicap). ; ■ ' 

7. Services needed by client adequately indentified, 



Explain how planned services will result in employ ability'. 



. Recording shows evidence of counseling and client's involvement in plan 

development. 

0, Record reveals client was made aware of his responsibilities (letter, W.-C-AOO). 

-1. Vocational objective appears realistic. If no, explain, 



12. • Economic need determined, 

PROVISION OF SERVICES 

13. Minimum of delay in providing planned serviccis. 

.'^ Other services needed, but not provided. If yes, explain. 



Services interrupted . If yes , explain. 



16. _ Appropriate use u.rde of other resources. If yes, describe. 



17. - Adequa^-e supervision provided client during' service' period as evidenced, by 

f";.v; * recording. 



EM£ DlSr.S Revised 2-71 . . "^^^ 



. JOB PLACEMENT. rO?.LO;v^-UP AND CLOSURE 

^S- Adcqu:jte assistance is placer^ent provided as needed. 

' ^ Suitable occjpation at closure. If no, relation between object ive\and job'" 

at closure does record reveal basis for change. V 

Adequate plan adjustments and plan revisions made. 

, \ Record reveals how client benefited from services. 

Appropriate standards for terminating case was met (basis for closing OS, 28 

and 30, denial letter , etc. ) • 

MISCEILAJTZOUS 

-^3- If rejec.ted, was client referred to other resources? 

2-- Material in folder neatly and properly filed. 

23. Recording in general seemed adequate. 

25. Proper use of funds. 

This space to be used for additional comments the supervisor feels 
should be brought uo the attention of the counselor and/or the 
administration. 



V?.-C-55 Okla. DISKS Revised 2-^, 
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CASE R£Vlr:V IKSTRUCTIOKS ^ VR-C-55" 

This forro is to be used tp record informarion obtained in a case review. It should 
also be used to counsel with the employee whose work is being reviewed and to assist 
the supervisor in preparation of his narrative report. The form is not to be 
subTiutted to the State Office. Explanation of specific items are as follows: 

PRELIMINARY I!A^£STia^TION , • 

1. All of the information should be completed at the *. ime of initial interview, 
except items 25-29. These should be completed when placed in status 10. The 
second page of the initial interview form should be completed in information, 
as requested. 

2. Did the case process evenly and expeditiously through referral and diagnostic 
process? . - 

3* Was sufficient medical and/or psychological evaluations received to establish 
eligibility and feasibility? Was recommendavion on general medical followed 
for special examinations? If not, was reason explained? Was explanation 
given for additional examination not recommended? 

A. If a training case, did the counselor provide sufficient and proper vocational 
testing to deterrrtine feasibility for his training situation? 

5. Other than having signed the application form. " 
CASE EVALUATION^ A.KD PU^.N'NING 

6. Fully describe parts 1 and 2 of the VR-C-18. 

?• Service, whether bought, arranged or provided by client, shown on total plan. 

B. Will services remove the disability or will it train around the disability. 
9. Show par t icipat ion. of both client and counselor iti plan development. 

10. Writte.n evidence of client having been made' aware of his responsibility. 

11. Is vocational objective compatible with abilities and disability? 

12. Economic need established, if applicable. 
PROVISION OF SERVICES 

13. Consideration given to individual situation. 

14. Diagnosis, physical restoration, training, whether bought or arranged for, ' 

15. Self explanatory. 

16. Self explanatory. 

\ 17. VThether by home or supervising counselor. 

IS. As indicated by case recording or correspondence. 
Okla. DISRS Rev ised^ 2-71 .[H^^^^I^^ 
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• training?r^°" ccnnpatible with disability, abilities, past work 

20, Self explanatory - matter of record. 

2K Case recording. ^ *' . " , ' 

22. According to agency manuals, form guides, end instructions. 
niSCHLIAKEOUS • ■ ■■ \ 

23. Self explanatory. 

, 24 .-^According to standard filing. ' 
.25. According to acceptable agency standards. 
. , 26. According to agency policies and regulations. 



\ 
\ 



! . 
/ 
/ 
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Department of Human Resources 
VQCATIONAL REHABILITATION DIVISION 

Administrative Office 

2045 SILVERTON ROAD N.E.. SALEM, OREGON 97310 PHONE 378-3850 
April 15, 1981 



Ms. Susan Stoddard 
Berkeley Planning Assoc. 
3200 Adeline Street 
Berkeley, CA * 94703 

Dear Sue: 

Following our conversation of yesterday, I discussed 

changes in our qjLijaJ.^ij y a ssurance process with our Ad- 
ministrative Reviev; Specialist. ' • 

The attached document describes our current standards 
and method of assessment. In our counselor perfor- 
mance appraisals, we do not consider quantitative fac- 
tors unles/ all qualitative areas have been found ac- . 
ceptable. 

It should also be noted tha^t this system is undergoing 
revision in ^.conj unction witl> our overall revisions of 
our Administrative Manual. I will send you a copy of 
these materials when they become available (July, 1931) 

If you have any questions, please feel free to call me. 



iSincerely , 




ROSS T. MORAN, Ph.D. 
Evalua t ion Specialist 
Program Planning and 
Evaluation 



RTM: skn 
Attachment 



AN EQUAL OPPORTUNITY EMPLOYER 



Commonwealth of Pennsylvania ^(fl^M^S^ Department of Labor and Industry 

BUREAU OF VOCATIONAL REHABILITATION 

Labor and Industry Building . 

Seventh and Forster Streets . ' 

Harrisburg, Pennsylvania 17120 



Susan Stoddard, Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, CA 94703 

Dear Ms. Stoddard: ^ - 

In response to your letter on iraterials used by our Agency for case flagging 
and quality assurance, listed belcw and attached you will find examples that we 
presently use in our Agency; 

A. Case Flagging * • 

Counselor Total Page 

The "counselor total page" is a two-page report compiled from relevant statistical 
data - obtained from a counselor's assigned- caseload. This report can be of valuable 
assistance in analyzing a particular counselor's caseload activities. This report 
is used by district, regional and central office personnel. • 

Seventeeli Status 10 Cases 

This report is another variation to the regular alphabetic counselor printout. .The 
use of this report enables management to specify one particular status from the 
regular alphabetic counselor printout . 

Cases in Status 10 for 4 or I-fore Months 

This report designates a specific number of months in a specific current status. 
This report is used by the district, regional and central office personnel. 

Cases Due for an Annual Caseload Review 

The Annual Caseload Report is available to assist rehabilitation staff in accomp- 
lishing the federally mandated annual comprehensive review as explained in the BVRP 
system. ..The report will produce a listing of only those cases that are to be reviewed 
withi^". a 3 -month peripd or are past due for a comprehensive- review. Cases that are 
due within the current month will be indicated by asterisks. One asterisk will be 
located to the left of the clients* last name, two asterisks will be located under 
the "data" column. If a case is past due, D's will be located in the same positions 
as the asterisks. This report is used by district, regional and central office 
personnel . • 
The above mentioned reports are available at the district office terminal . 
Delinquent Anjiual Caseload Reviev; Cases 

There are tvx) types of reports. Both are attached. One report is a delinquent 
listing of cases by counselor sent to each district office. The other report is 
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rci>Dx^t is a ciunidative report of delinquent annual caseload review cases that 

is fonratted and sent to all appropriate district, regional and central office staff 

B. Quality Assurance 

Similar Benefits Utilization (Dookle t) 

This is a structured system which is presently being pre-tested in a pilot study 
to identify and collect, via the teleprocessing unit, the clients that use similar, 
benefits, sources of similar benefits, services utilized in similar benefits and 
cost savings by usixig similar benefits . This is primarily a manageiTient . tool to 
mDnitor quality and quantity of sijpilar benefits utilization. Additional infor?patio: 
is stated in the attached booklet. 

Case Review Process in Pro.gram. Evaluation- (Booklet) 

A structured process such as a case review system is used to monitor and identify 
case ser\/ice patterns within the rehabilitation process. The entire process is 
contained in the attached booklet. 

Evaluating the Severely Disabled Client Population 

Served by the 

Pennsylvania Bureau of Vocational Rehabilitation , (Booklet) 

The ijiforration in this booklet is used to monitor and evaluate the four, types of 
severely disabled client population. Tne data ^rom'the computer ^ printout is j . 
forrr^tted for meaningful utilization by central office and district office staff. 

We have found, through our exp'eriehces , that our procedures for case flagging 
and quality assurance l-ave been very effective from managem.ents * and counselors/ 
pers T^ectivG , since they m^eet c\xc needs and are assembled, developed ahd formatted 
for the intended user . ' ' 

If you have any questions cor.ceming our material on case flagging or quality 
assurance, please feel- free to contact me. 

Sincerely, 



George C . TjOwe , Jr , 
Director 
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COMMONWEALTH OF PENNSYLVANIA 
DEPARTMENT OF PUBLIC WELFARE 
OFFICE FOR THE VISUALLY HANDICAPPED 

P,0. BOX 2675 

HARRISBURG. PENNSYLVANIA 17120 



May 12, 1981 



Berkeley Planning Associates 
3200 Adeline Street ^ 
Berkeley, California 94703 

ATTENTION: Susan Stoddard, Project Director 

\ 

Dear Ms. Stoddard: 

In response to your letter of April 6, 1981, I have had 
my VR sta^f assemble the attached materials which! hope will be 
of some value to you. 

The first attachment is our Case Management Exception 
Listing which allows both our VR' counselors and supervisors to moni- 
tor all those cases in a couaselrcSr^s caseload which exceed a specified 
number of months in a particular- status. Attachment Number 2 provides 
the parameters upon which the Case Management Exception Listing is 
based. We have found this management approach to be quite beneficial 
and our practice has been for the listing to be reviewed by the VR 
Supervisor in our field offices on a quarterly basis with the VR 
counselor. 

We are presently in the process of developing chai^ters 
for a VR counselor's handbook which will include procedures, review 
techniques, etc. to identify undue delay in case statuses. We are 
still in the process -of refining our instructions in this area and 
do not have them yet ready for publication. 

Regarding quality assurance in the VR program, our approach 
has been to conduct program and administrative reviews, including the 
review of records, review of procedures in our field offices, as well 
as on site client satisfaction surveys with "a random sample of clients 
successfully rehabilitated. We have" found this approach to be quite 
effective and well worth the extra time involved. We are also in the 
•process of developing manual chapters for our VR coutiselor handbook • 
to further specify these aspects of the VR process. However, we can 
share vzith you a copy of our memo of expectations which serves as our 



er|c 



primary guideline at this time* We will be modifying some of our 
Expectations venos ^''hen our additional guidelines are published, since 
we have experienced some significant changes since the time the memo 
was published. We do feel, though', that it will prov^j-de you with an 
idea of some of the performance standards we have established. 

We hope that this information will be of benefit to you, 
and please let us know if we can be of any further help in the future. 




JAS:cl/vmb * 



Attachments 



197 



OA-501 



12-67 



COMMONWEALTH OF PENNSYLVANIA 

December 22, 1976 



suDJECT-.Case Management Exception Listing ' 



VR Counselors 



FROM: 



Alice M. Taylor 
Assistant Manager 

A product of our new EDP will be the provision to each D.O- a separate 
monthly Case Managament Exception Li.s^ting by Counselor Code. This will 
serve as a supervision and management tool. It will show cases that .have 
remained in the same status for a period of time exceeding an acceptable 
time frame. 

The list will include cases tuat have been in a given status longer than 
the period shown here: 



Status 


No. of MOr 


Status 


No . of Mo . 


00 


. 4 


16 


• 9 


02 


A 


18 


48 


06 




20 


6 


10 


.6 


22 


3 


12 


3 


24 


6 




6 


32 


12 



Attached is your simulated list and r understand it is only a part ial . list . 
A more canplete list including the simulation should be received soon. How- 
ever, for now "it is important to keep the attached in your work file, reviev; 
it and attempt to move the status of clients listed, 

VJhen complete monthly Case Management Exception Listings are received, the 
Counselor should proceed as follows: 

\ ■ . ■ 

1. Review each record listed, 

2. Determine cause of stagnant status. 

3 . Show in an R9: 

a. What you will do to expedite status movement^ or direct 
supervisors attention to the fact that this has already 
taken place, ^ 

■ • 

b. Justification, where applicable, for case having' been 
too long in a status, or for resubmitting to that status'. 



ERIC 



198 



-2- 



• Eyliiliit ^^^^ records to sujjery i sor wlvo will deLennine v/hether 
t^^^ casoG may bo reiuibiniLLing do FDP , thus allov/inq an 
additional similar t,ijn^G f rame > , 

It is vital that we do not ignore the new service; that we* recognize the- 
need for better caseload management; th^t we document justification v;here 
it applies and that t'-^e supervisor is involVRd in that decision^ 

This is preliininary information which we can pursue at VR staff conference 
in January, 1977 ^ 

mT/30 

Attach. 

cc! Mr. Apgar 

Mrs. Taylor ^ 

S tati£3tical {Computerization) file 
Caseload Management (VR) file 
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SUBJE.CT: 



COMMONWEALTH OF PENNSYLVANIA 

Novcfiiber 20, 1978 



OVII/VH-79-2 

Expocl.iLioiis for DislricL Offico and Fi.cidwork FuncLion 
i-n Lhc Vocnlionai. Rehabilitation Program. 



TO: 



All District Manaj^ers 



rwoM. 



Hal])li P.. Upislline 
Coiiuni ss ixOiier 



The District Mnnaj;ors with direct line authority from the Commissioner 
assure that the following performance expectations are enforced at the 
District Office l.cvol. It is understood that the District Managers 
delegate au thor i ty and responsibility to subordinate management and 
supervisory personnel, however, ultimate responsibility for compliance 
rt^sts with the District Managers. 

These expectations have been ' revi sed as a resuU of the Central-District 
Offices meeting in wliich all District Offices uvre represented held In 
Central Office, October 6, 1978, 

The following expectation's are effective inunediately: * ' 

1. WOKK ITT N'KILA RIBS 



'llie District Manager assures that all Vocational Reliab 1 1 i ta t ion Staff 
submit to their inunediate Supervisor a de ta i led i tinerary for tlieir 
proposed activity covering the next week. Itineraries arc due on or 1 
before each Friday. The' i tincrary contains tiie individuals to.be 
contacted and .the. purpose for each contact, as well as days in the offi 
and leave days planned. Any change in an itinerary is liandwrittcn but 
cleared in advance with the Supervisor. The following factors are 
considered in planning, preparing, and evaluating work itineraries. 
The District Manager assures that: 

A. Caseload carrying VR staff average 507. of their time in the 
field and 50% in the District Office. 

D. O^M VR staff average 807. of their-time in the field and 207. in 
.the District Office. 




C. / Caseload carrying VR. staff average l.he perfcriuance of eight ■ 

(8) employer contacts per staff member per month. 

D. Caseload carrying VR staff average tlie performance of five (5) 
direct personal contacts wi tli clients, employers, or cojnruunity * 
facilities, per staff member, per day in the field. 

E. 0/vM VR staff average the provision of , 0»!vM training to " 
two and one-half (2-1/2) clients per day in the field.. 

2uo ; . * 4r<:^i 
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F. Allvf^inornrics arc mainlaiuGd on file, for ai loasl one (I) 

complcLc Foderal fiscal ycai: prior lo the pvG.sonl fiscal year, 
io clolonninp wholhor adocjualG planning is hcin^ used iii preparation 
of 1.1 mcrarics, lUo Mana^;cr coniparos ihcm lo Iho GMiployGo's 
cxpon.se account pc r iod i ca ! l.y . The need, for work conforonces 
and/6r trainings are developed from sucli comparisons. 

Averages roforred to in item "A** tlirourJi *'F/' are computed on a monthly 
Dasis and applied to tola] staff in each VR r.roup, i.e., caseload 
cnrryinf; or UUl staff. Thi.s permits tl,e DLslricl Manager the flexibility " 
01 csLablishing special work assignments if desired, such as facility 
01- placement functions. 

Itinerary files are subject to Central Office review. 
II. CASE M/vtlAGF.MKNT 

The District Manager establishes procedures (such as random sample case 
reviews, review of selected cases from the VR staff's exception lis ts, 
nnd/or individual or group VR staff conferences) to insure proper case . 
management and effective service delivery. The following factors must 
be addressed: 

A. Thai .^igniflcknt narrative entries are inserted in all case 

records at appropriate points, but at no grea ter^ in torvaT ' than 
ninety (90) dbys. 

' I ■ ■ 

i:. That informal^^ion regarding job placement contacts, perfor ^^d by . 
both client and counselor, are narratively documented in all 
cas^ii records." 

C. That an average caseload, of caseload carrying VR staff cons is ts 
of a maximum of- ISO cases. The cases are distributed into 

507. in status 00, 02, and 06; and, 50% in status 10 through 

D. The review of the exception lists of all caseload carrying VR 
staff on a monthly basis. Case record review and conferences 
with VR staff will detemune whetlier the delay in a particular 
status is warranted and sufficiently documented. 

c. Supervised monthly review of all caseload carrying VR staff 
Piaster lists. Errors or inconsistencies are resolved by VR 
stajff ])y submitting correcting documents to the District Office 
Data Control Clerk. 

F. That all caseload carrying VR staff will prepare and submit 

. to the District Office Dala Control Clerk those forms necessary 

for the updating of tlie master lists a-i each required reporting 

event occurs. 
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G. Thni a I o;; sysUctn will ho usrd for mnintnining an accurntc and 
Liiiioly noLatLon of rcfcrr»:l. dales. 

The District Maiia^^or assures the oval ua t ion of the ahove factors in 
conjunction wltli (hay-to-(hay reviews of: approval of IWRP's, IWKP Amendments, 
and all closu re act j ons which identify individual and group problems. 
-These problems can ho treated by: 

A. Jn-sorvice training at the District Office* level. 

; .y ■ 

On-tho-job training l)y the Supervisor. 

C. Consultation with and/or assistance from Central Office 
Specialists. ' 

D. S ta tew ide in-service training, 
III. EVALUATION OF STAFF PERFORMANCE 

Adequate VR staff performance and client satisfaction shall be evaluated 
via the following nianagement and supervisory activities: 

A. All VR staff shall be accoiTipani ed in the field by a District 

Office Manager or Supervisor to wlioin he is subordinate, at least 
■ two (2) full days per Federal fj seal year. Counselors evidencing 
prohltMns siiall be accompanied move often. One indicator would 
ho a connst?lor*s inability to meet ner.otiated production and/or . 
assi^;n(Mi ca Logorica 1 p 1 acemon t percentages at the end of each 
(juarter. Ongoing observations will allow the evaluation of 
VR staff effectiveness. Areas to consider include, but are 
not limi ted to: " " 

1. Efforts to involve the client in'tho development and 
implementation of the client's rehabilitation program. 

2. Ability to achieve predetermined objectives and goals with 
and for the client. 

3. Effective counseling skills. 
A, Effective communication. 

5. Aw»areness and utili^tation of corniiiunity resources. 

6. Effective use of itineraries. 

7. Satisfactory performance of employer contacts including, 
pvcpara t ion. - . 

8. Effective training techniques. - , 

9. Application of appropriate training. content, 

VR staff itineraries should be utilised to determine the dates 
^ 1 selected for this observation activity. 
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A rocord of Lliis ncLivily r.lu'ill be in.-n* n t.n I nc<] in Ihc Districl 
Mnn;ij;(M:'5 V\\ S I n f f To r To nrinncc Folder. Tliis folder is 'subject; 
to CenLral Office review. - ' . 

B. A socoi\d iiioasurc of VR staff ])crf onnntice " and client snLisfaction 
is ,nccom|)l ishcd by. use of field nudits./Tlie tnannger assures 
ihnl bo or a dcsi[;nate<l Supervisor wil], review the 
case rec(M'(ls of, and pcts_onnlly^ contact at least throe (3) 
clienls iiioiuh. Audits sliall be distributed over all VR 

caseload carrying; staff, and far tliis fiscal year shall be 
con<!ucted on sj:atus 20, ready for placement, cases which appear 
on tlie exception lists. The VR staff nieinber serving the client 
will not be involved in tlie personal contact with t\(e client, 
but will receive wri iLen findinxvs and recotnnicndations froiu 
the audit wliich will be placu<l in the District Mana[*,er's 
rpecial AudiL Folder, This folder is sul)ject to Central 
Office review. 
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COMMONWEALTH OF PUERTO RICO 

DEPARTMENT OF SOCIAL SERVICES 
SAN JUAN. PUERTO RICO 



P 5 




April 24, 1981 



OFPICE OF THE SECRETARY 



Ms. Susan Stoddard 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 

Berkeley, California 94703 

./' 

Dear Ms. Stoddard: 

In answer to your letter of April 6th> we are enclosing several 
materials used to avoid or identify cases experiencing . undue delays 
in our VR Program.- . ' ^ 

'Each counselor mar.ntains a Master List of his/her clients, and\^ 
indicates the - month in which each status change is made.. The Coun-^ 
selors' Manual m'entions establishes maximum times in certain statuses.^ 
(See copy of Chapter 7 enclosed.) • , 

/ ■■ 

In conducting case reviews, we use the Caseload Analysis form 
enclosed,, to check on the distribution of cases. If the counselor has 
an exceptionally high percentage of cases in certain statuses, we then 
check to see, if there have been delays and why. ^ 

We use a modified version of the Case Review Schedule to review 
random samplings of case records of each counselor in each service 
region on a periodic basis. Central Office administrators then discuss 
the quality of case recording and service delivery in meetings with the 
counselors, supervisors and regional area staff. 

We -are' interested in receijVing a copy of your survey resultsv 



V 



enclosure 



Cordially, 

Luis A< Bonilla 
Assistant Secretary 
Vocational Rehabilitation 
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Of icina: 



DEPARTAMENTO DE SERVICIOS SOCIALDS 
Programa de RehabiUtaci6n Vocacional 
Sub Programa Obreros Lesionados 
. San Juan, Puerto Rico 

• ANALISl'S DE CARGA'dE CASOS (6sLA.t/^a^ 
. R.V. 101*1 Correspondiente a: 




Casos Referidos 


NCim, de Cases 
en el Status 


^ Porciento ^ 
^ en el Status ^ 


Porciento ^ 
Adecuado 


Diferencia 


00 






• 6.0 




02. 






25.2 . /' 


/ 

/ 


. 06 


^, •• • 




— — ^^-^ 

6.8 


1 

. / 

•/ 


Sub Totales 






38.0 




/ ■ , ■ ■ , • ' • 
/ ' ■ ' ■ ■ ' • . • ■ 


/ 

Casos Activos 


1 

Nfim. de Casos 
' . en el Status 


Porciento ' 
' en el Stbtus ' 


Porciento 
Adecuado ' 


Diferencia 


10-12 






9 ^ 




• 14 






5.5 




16 






11.0 




18 


<• 




18.7 




20 




! 


6".2- ; 




22 






8.0 




24 






.2.4 





Sub Totales 



62.0 




Fecha 



2U5 



Firma 



/. 



STATU OF RHODF: ISLAND AND PROVIDENCE PLANTATIONS 



Departn^ent of Social and Rehabilitative Services 
VOCATIONAL REHABILITATION 
40 Fountain Street 
Providence, R.l. 02903 

(401>421-7005 April 15, 1981 

Susan Stoddard, Pro ject \Director 
Berkeley Planning Associates 
3200 Adeline Street 

Berkeley, CA 94703 s 

Dear Ms. Stoddard: . . • 

The enclosed material is in response to your written 
request of April 6, 1981. 

I have enclosed pages from a . computer print-out • for 
one caseload. Each counselor is provided with such a print- 
out on a monthly basis with the Supervisor receiving a set 
of similar print-outs of .all caseloads under his jurisdic- , 
tion. You will note in the first column identified as "FL" 
are asterisks flagging cases in status beyond allowed per- 
iods of time. I have enclosed a table of allowable- periods 
of time for each status. Counselors are required to justify 
the existarice of flags on a monthly basis. 

Caseload monitoring is an ongoing responsibility of the 
agency's Program Evaluation Unit which samples cases from* 
all regions for compliance with federal/state requirements 
in addition %o standards set by the agency. We have recently 
introduced a Caseload Management Guide to all staff which is 
fashioned after the instrument developed by the Region I 
RRCEP at Assumption College in Worcester, Massachusetts. I 
have enclosed a copy of this guide which is, at present, only 
complete to status 12. We are presently completing the 
balance of the. status requirements and standards and follow- 
ing their introduction, the ag[ency will implement a Supervisory 
case review checklist similar to that of the Case Review 
Schedule of San Diego State University. At that tiitie. Super- 
visors will be reviewing cases with a standard instrument while 
cases will continue to be monitored by the Program Evaluation 
Unit on a sampling basis . 

I trust this information will be helpful to you. 




b^aid sT^fiesketh 
Assistant Administrator 
Vocational Rehabilitation 
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Si'lur.CT: Time in status 

■ In order to insure timely iriovenient -of casi^s through the r^e- 
habilitation process, the agency's Program Evaluation Unit has " set 
the following allovv^able times in each status: 

STATUS ALLOVvABLE TIME 

00 " 30 days 

02 3 months 

0 6 * — " 2 months 

X' ' ■ ■ 

* 10 — " 3 months 

<»• 

12 1 month 

14 12 months 

6 months 

17 . 24 months 

18 12 months 

20 2 months 

22 ' 2 months- 

24 ■ 3 months 

32 6 months 
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south coroiina 
commission fa the blind 

1430 CONFEDERATE AVENUE • COLUMBIA, SOUTH CAROLINA 29201 
TELEPHONE 758-2595 



MAXINE R BOWLES. COMMISSIONER 



April 22, 1981 



BOARD 

ALLAN C MUSTARD 

Ch,iirmjn 
Cfilumt)),! 

A. PETER ANSELMO 

Vici-Ch,urm,jn 

MRS. EARLENE GARDNER 

SecnMarv, 
Aikrn 

MRS. ONNIE BARHAM 

Columbu* \ 

ROBERT R. BELL 

jMi'mlK-r 
Lourcns 

CLAYW. EVATTJR. M.D. 

Chjrk'sion 

SAMUEL LEE ZIMMERMAN 

Crifnville 



Ms. Susan Stoddard, Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: ^ 

/ . 

This is a reply to your letter of Apr i 1 6nh addressed 
to Commissioner Bowles. 

We are presently using the Oklahoma Data System^ 
to obtain the information for our R300 tapes. This 
Systeim generates a "time in status report" which can' 
be used by supervisors and counselors to iden'tify 
those cases that have been in' a particular status for 
an extended period of time. Enclosed is a copy of 
the input document for our data system as well as*an 
explanation of the "time in status report". 

All cases closed in statuses 08, 26, 28, and 30 are 
reviewed by the^Area Supervisors* Enclosed is a copy 
of the review form. Our plans are to update this form 
in the near future. ^ 

Our Program Analyst who is under the direc t^supervision 
of our Commissioner does .the follow-up studies as re- 
quired by the federal regulations as, well as periodic 
case reviews as he may deem necessary. 

Please let me know if you need any addi tional information 
or assls tance . 

Leonard A. Cooper 
Atts. " Rehabilitation Supervisor 

LAC : Iw 

cc: Mrs. Maxine Bowles, Commissioner 
Mrs. Nancy Buchanan, Deputy Comm. 
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sour F CAROLINA (fOMMISSION FOR THE BLIND 
CASE REVIEVV FORM 



A. OFFICE 



COUNSELOR 



CASE NUMBER 
RACE 



AGE AT REFERRAL 



SEX 



EDUCATION 



I 

REFERRAL SOURCE 
DATE OF REFOiRRAL 
ACTIVE CASe\ 



STATUS 



PRIMARY DISABILITY 



SECONDARY DISABILITY 



CLOSED, CASE 



CODE 
CQDE 



B. DIAGNOSTICS AND EVALUATION: 



4.2 Medical Di agnostics Provided 

V 2. Audiological Evaluation Provided 

f\r 3. Other Specialty Exaniinations Provided 

WHERE INDICATED SPECIFY: 



YES 



NO 



N/A 



. ^./jS 6. 
-^■■^S 7. 

y. c^? ^ 8 . 

10. 

: 12. 



Use of Medical Consultation Documented 
Psychological Evaluation Provided 
Vocational Evaluation Provided < 
Diagnostic and Evaluation ,Findings\Summarized 
Disability Documented and Related to Vocational"' 
Handicap ^ 
Eligibility Decision Adequately Documented, and 
Justified .1 
Documentation that Client was Advised of Findings 
Extended Evaluation Used 
EE Plan.Completed 



\ 



\ 



ERiC 



Report Narne and Number : ' ^ 

* Time-In-.Stotus Report CBREH228 
. Run FreQuency : 
Monthly 

Distribution: * * . . 

Rehabilitation Supervisor, Data Unit 

D escription : . ^ • 

'This report list by status code then alphabetically by last nare 
all cases for each counselor which have been in a certain status too 
long. The criteria for overtime status designation are as follows: 

Status. Time Limit (In Months) 

V 

00 ' ' ■ 4 • " 

02 - ' - 6 ' 

06 19' ■ ■ . 

10 • 6 ■ . . • 

12 6 . 
14 - 12 

,16. 12 

13 99 (Maximurn di ffers with trainini 

facility code) 

20 - . 4 

22 . 4 ' . • 

24 . .. ■ 4 , 

A recap by status is provided for each counselor and for the state. 
Adva ntaoes : ^ . ' / " 

This report is very helpful for efficient caseload management. The 
counselor, a/ea supervisor or rehabil itation supervisor can use this as a 
^cn/ick guide to find slow spots in each caseload and "to 'find cases that need 
to have action taken on them. 
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~~ UKSE REVIEW FORM \ . I 

■ Page 3.. 

* ■ • 

D. SERVICES (continued) YES NO N/A 

1. Placement and Follow-up 
m. Posl-Employmenl Services 

n. Occupational Licenses, Tools, Initial Stocks and 
Supplies^ Other Goods and Services 

.2. a. Did Client Attend a Rehabilitation Center 

Specify: ; 



b. Required Information Provided to the Center 
Prior to Admittance 

c. Periodic Progress Reports Provided by Center ^ 

d. Center Recommendations followed in this case 

^.af)3. a. All Planned Services Provided and Documented 

4 . a . Timely Manner According to-the Time Frame 
Established in the IWRP 

5./ Employment Obtained: 

a. By Client ♦ 

b. By*Couriselor 

c. Client Returned to Previous Job 

d. Other - Specify: ^ * 



6. Number of Contacts Made During Follow-up 

7 . Length of Follow-up 

8.. Employer Contacted During Follow-up 

9. Client's Family Included in the Rehabilitation Program 



E. CLOSURE > . 

^•c^l. Reasons for Closure Documented and Justified 

y^c^^-/^^2. Client Notified of Closure 

3. Referral Source Notified of Closure 

4. All Required Forms Completed 

yV. V 5, Post-Employment Services Planned for if indicated 

6. Job Title at Closure 

DOT Code ; 

7 . a If Job Title at Closure Differs From Initial IVVRP , 

Change is Documented and Justified 
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cash: REVIEW FORM 
^Page 2 ■• • 

C; DEVELOPMENT OF THE IWRP: 



^7.^1. IWRP Completed 

2. Vocational Objective: 
DOT CODE: 



'/l.-C-3. All Indicated S ervices Planned For 

;$^d-4. Services, Vendors and Costs Specified and 
Justified ^ 
Client Responsibilities Specified 
"7 5* ^- Agency Responsibilities Specified 
}/}pT^^^ ^ 7. Clients Economic Needs Investigated and 
Docunnented 
8. Use of Similar Benefits and Community 
•Resources Planned for and Documented 
; ... S 9. Development of the Vocational Objective Fully 
Documented and Justified 
^•o" 10. Client Involvement in the Planning Process 
Documented . , 

fOAf^lll, Timetable for Achievement of IWRP Goals 
c^^/^ Specified* 



D. SERVICES 



1. -Type of Services Provided: 

a. Evaluation 

b. Counseling and Guidance 
^fB^ u • c. Physical Restoration 

^ . d. Mental Restoration 
^^{pl -e-. Vocational Training 
Specify Type: 



^T.cr?'/ Maintenance 

- <9n g . Transportation 

^.3V h. Services to Family Members 

i . Interpreter Services for the Deaf 
S *2j^ j . Reader Services for the Blind 
^•35^ k. Telesensory, Sensory and other Technical 
Aids and Devices 
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CASF^ REVIEW FORM 
Page 5 



10. COUNSELOR COMMENTS: 



REVIEWER 



COUNSELOR 



DEPARTMENT SUPERVISOR 
PROGRAM EVALUATOR 
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CASE REVIEW FORM 
Page i • 



b. Briefly Summarize Reasons for 



YES NO 



N/A 



F. OVERALL QUALITY: 



1. Case Handled ir> Accordance with Agency Policies and 
Procedures ■ " . 

2. Contacts made, on a Timely Basis 

3. Contact Reports Thor^ugli 

4. All Required Documents on File 

5. Documents filed in Accordance with the Uniform Filinpr 
System 

6. Documentation that the Client was informed of his 
Rights to Administrative Review, Fair Hearing and ' 
Nondiscrimination under TITLE VI of the Civil Rights 
Act of 1964 

^J<pK ' All Vendors Providing Dirrct ^jsrvic^s to the Client 
in Compliance with TITLE VI 

8. Referral Source Kept Informed of Prorress in Serving 
the Client 

9. Ccmmerts and Rt :ommendations for 1 rn-^ ovements 
in Case Handling and Recording: 



/ 



/ 
/ 



7 
7" 
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Susan Stoddard 

Page 2 

May 1, 1981 

(10) Exhibit J - RSA-101 - Quarterly cumulative caseload report. to RSA. 

(11) Exhibit K - RSA-102 - Quarterly cumulative report on public 
assistance and severely disabled clients. 

(12) Exhibit L - RSA-13 - Quarterly VR program progress report to RSA.' 

Most of the above reports are available on a Department, Division, District 
Office, and Counselor basis. 

We hope this information will be of interest to you. 
Sincerely, 



Clinton H. Nielsen 
Program Administrator 
for Client Ser\^ices 

CMNVcb 

Enclosures 
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iS*55r^?% STATE Of SOUTH DAKOTA 

Tl DEPARTMENT OF 
V VOCATIONAL REHABILITATION 




DIVISION OF 
REHABILITATION SERVICES 



. Richard F. Knoip Buiidin() 
Illinois Street 
Pierre, South Dakota 5750,1 
605-773-3195 
TTY 605-773 -1544 



May 1, 19S1 



Susan Stoddard, Project Director • ■ ; ; 

Berkeley Planning Associates . ' 

3200 Adeline Street 
Berkeley, CA 94705 

Dear Ms. Stoddard: ' • , 

\ -1 A 1QR1 relative to quality . assur- 

^«od bolow and xerox sample eopies are enclosed. , 

Exhibit ^-«Caseloa4 Reports - >,ontMy xepert each counselor rcce.ves 

VIZ^" "d^sT^^^ case flow and lags^in proeess.ng., 

. St-^ino^c;n?-?':e-:j;!SL;.?er^ri^st^^^^ 

-iof.f-peSdirerinfi-ar-4^^^^^^^^^^ 

and Section 110 funding- - , ^ ^ 

r, ■• T^ei- Yparlv report for each counselor ■ 
i?i,f;fi^iLVia?rerir1lSe.^"for\ra^evL„.ecause.^^ 

bility determinations. 

,S1 Exhibit H - SSA-8S3 Report - Monthly agency report to Social Security 
Sinfs»aUon on SSDI and SSI closures.. , 

(9) Exhibit I - RS,\-100 - Monthly production report to RS.\. . , 



Ms. Susati. Stoddard 
Page 2 
May 5, 1981 



STATUS 



00 
02 
06 
10 
12 
16 
18 
20 
22 
24 

To help insure cases in Extended Evaluation do not 
remain longer than the permissible 18 months, a print- 
out identifies cases that have been in Extended Evaluation 
for.- 17 months . 

To help determine the appropriateness of client 
expend! tures / we have a revievj of expenditures at-certain 
expenditure levels by supervisory staff. A^quarterly 
Encumbrance Report print-out provides information for 
this review. The first line supervisor approves cases 
at the $5,000 expenditure level; the regional director 
at the $10,000 level, and the state office field service 
section at the $25,000 expenditure level. 

Vie hope this material and information will be of 
benefit in your project. Please let me know if you 
have questions or if we can provide additional 
information. . ' ' 




0!ck Van Kooser 

irectbr of Client Services 
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LEMGTH 
120 days or more 
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1,825 


It 


tl 


It 


122 


It 


V 
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91 


tl 


It 


tl 


182 


It 


II 


It 



Attachments 



STATE OF TENNESSEE 
DEPARTMENT OF EDUCATION 
Division of vocational Rehabilitation 

1808 WEST END. ROOM 1406 
NASHVILLE. TENNESSEE 37203 

. May 5, IS'Bl 



Ms. Susan' Stoddard 

Project Director 

Berkeley Planning Associates 

3200 Adeline Street 

Berkeley, California 9U703 

Dear Ms. Stoddard: 

Mr . 0 . E. Reece requested that I respond to your 
request for infc/rmation concerning quality assurance 
and case flagging. We are pleased to provide this\. 
information for your review. * \ 

We have a Quality Assurance System for the purpose^ 
of establishing appropriate standards, monitoring ^p^.o-y 
gram activities on" a regular basis, assessing activities 
and implementing program changes. .Attached, please^ind 
a copy of our A.gency manual' sect ion regarding Qua^i^y 
Assurance. /: 

Each quarter quality, assurance assignments are 
made to the agency's first line supervisory staff on 
subject areas felt to be in need of study. This manual 
section includes the forms used to report the review 
findings. The a*ttached Case Review Eorms are \\sed for - 
conducting the reviews for both the counselor casework 
and the facility casework (TVTC Quality Assuranc^ A 
Key to Summary Rating Eorm for the Case Review Eorn\ 
is also attached. 

To reduce potential case management problems that 
may develop due to cases remaining for long periods of 
time in certain statuses, we have a quarterly ^ print-out 
of exception cases. The Exception List identifies by 
counseling district those cas^s that have been in a 
status longer than permitted by policy (Federal or 
State). Cases in "the following statuses longer than 
indicated would appear on the Exception List for 
supervisory staff and/or counselors to take appropriate 
action: 
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DlVlMOIiOF VOCAir 'jlL RtH/iBILITATION 
CASE REVIEW SOHFM REPORT (lA-2 



Case Reviewed by 



Strongest Points Found in Review 
Weakest Points Found in Review 



Action Needed to Correct Weaknesses 

'^atus at Revie w 
Key 

4. Excellent 
3, Good 
2. Acceptable 
1, Poor 
0. Unacceptable 
HA. Hot Applicable 



I. Intake Information 



IL Vocational Appraisal 



II I. Adjustment Services 



IV. Provision of Services 



V. Placement and Follc^-up 
Overall Rating. 



Corrective Action Indicated: Date 



Corrective Action Completed: Date 



cc: Regional' Director and Central Office 



Date of Report 



Dist 




22U 



strict 



Reviewed by 



DiVlblUN Ue VUCMIiUNAL KtriMb lu 1 i iOr< 
QUALITY ASSURANCE CASE REVIEW SUMMARY REPORT 

Date 



of Report 



QA-1 



Key 

4. .Excellent 

3. Good 

2. Acceptable 

1. Poor 

0 Unacceptable 

NA. Not Applicable 




^TATIK AT DC\/TCU 
O 1 M 1 Uo Ml KtvltW 














!• . KeTerrai ano inves l iga uion 














ii» ue Lenn 1 na 1 1 on or tngiDinLy 














iii*rlai1i1iny 














IV. tconom 1 c neeQ 














V, oiim lar beneti ts 














vi. opeciai rrograms 














VII. Counseling and Guidance Services 














Vlll, Physical Restoration Services 














, ix. Training Services 














X. Maintenance 














.-^XI, Transportation 














Counselor Supervision of Case 














XIII. Case Recording 














. Placement, Follow-up and Closure 














Rating Average (Nearest 10th) 




























APPROVAL OBTAINED: YES OR NO OR NA 














Case in Status 00-02 over 120 days (5) 














Provision of Physical and Mental Restoration (S) 














Out-of-state Training ; (S) 














Case Encumbrance Exceeds $5,b00 (S) 














SSl/SSDI Case Status 12-24 Not Assigned (S) 














tase Closure (S) 












Exception to Economic Need (RD) . 














Co i lege case requiring maintenance beyond 4 years 
unJ tuition past the undergraduate level {RD}* 














Case Encumbrance Exceeds $10,000 (RD)* 














^.Out-of-state Physical Restoration (CO) 














Vw^ase Encumbrance Exceeds $25,000 (CO)- 














Was there any evidence of discrimination based 
on Raco, Sex or Handicap Yes or No 














Corrective action needed by Date 














« O : — ' 

ERIO corrective action completed "^2^ 




- 











Key to Surrmary Rating 



STATE OF TENNESSEE 
DIVISION OF VOCATIOrWL REHABILITATION 
QUALITY ASSURANCE . 
CASE REVIEW FORM 



4. Excellent 
3- . Good 
2. Acccptablo 
K Poor 

0 Unacceptable 
NA, Not Applicable 



Client Name 
District 



Status 



Reviewed by 



Date' / 



1 . Referral and Investigation 

R-2 Completed Adequately 
Counselor's Page Adequate 
Was Psychological Testing 

Administered 
Vocational Evaluation Provided 
Problems' Adequately Identified 

and Investigated 

If no I why _ 



Yes 


No 


NA 


Yes" 


_Mo_ 




Yes 


_No_ 


NA 


Yes] 






Yes 


No 


NA 



Diagnostic Information Obtained 

Without Cost 
Was 08 Closure Justified 

If no, explain in "Remarks'* 



Yes_No_NA 
Yes No NA" 



Summary Rating 0 12 3 4 
***************************************************** 



IK Determination of Eligibility . 

General J^edi cal Adequate 
If no^ explain 



Yes No 



Speciality Examination(s) Adequate Yes^No_NA 

If no» explain — 

Case Data Clearly Establish 

Vocational Handicap , Yes ^No 

If no, explain in "Remarks*' . 
Was Case Properly Identified as SD 

or NSD V ^ Yes_No_ 
Disability : . 

Summary Rating 0 12 3 4 NA 

**************************************** V******* 

III. Planning 

Was there -Evidence that Client and Counselor 
Planned Program Together Yes Hn 

Were Appropriate Services Planned to 

Meet Client's Needs Yes_No__ 

ERIC 



Was Program Objective 

Realistic 
Program Objective 



Yes No 



Suimary Rating 0 12 3 « NA 
****************************************** • 

IV. Economic Need 

Were Services Based on 

Need Yes__No_ 
Is the Determination of Economic 

Need Adequate Yes__No__ 
New TVR-12 Obtained as 

Needed ■ Yes_No_N:A_. 

Summary Rating 0 1 2 3 4 NA 
********************************************* 

V. Similar Benefits 

Was there evidence that similar benefits 
were considered Yes ^No — 

Were available similar benefits used 
- Yes ^No_. NA 

Were similar benefits used 

appropriately Yes__No_NA_ 

Surmary Rating 0 12 3 4 NA 



VI . Special Programs 



Allowed 55DI 



.SSI 



NA 



Was Special Funding Used Yes_„No_NA__ 
Was Case Properly 

Documented Yes_No_NA_ 
If no, explain in "Remarks 

■ Sutmiary Rating 0 1 2 3 ^ ^ 
****************** 
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Sample Form QA-5 
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WEEKLY ENCin-SRA.NCE REPORT CHECKLIST 



REPORT 



DATE 
RFAEyED 



SECRETARY 



ERIC 
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12/20/79 



XIV, P1ace^.ent', Foll o w-un and C1osur e(St . 22 

Was there Evidence that Counselor 

Assisted Client in Placement Yes ^No NA^ 

Occupation ^ \ \ 

Weekly Wages 



Is Employment Satisfactory \ Yes No 

Did VR Services Contribute to"^ the 

Individual's Placement \ Yes No _ 

Were Placement tools and equipment 

Provided . Yes_No 

If yes, was provision of this service ' 

justified Yes ^No 

Case Followed 60 Days in Employment Yes No NA 

Client Notified their Case 

was being closed Yes No ^f^A 

Referral Source Notified of Closure Ves_No NA 



Surr.mary Rating 0 1 



NA 



Was there any evidence of discrimination based 

on Race, Sex or Handicap Yes ^Mo 

If yes, explain on bacJ'^ 



Ado rpfTfj_aj:j^_j^ 

Case in Status 00-02 over 

120 days (S) Yes_Uo_NA_ 

Provif^icn of Phvsi cal 

Restcrution " (S) Yes _ No_NA_ 

Out-o: -State Training (S) Yes Nc^'^'' _ • 

Cjse Encumbrance Exceeds . 

S5,GO0 (S) Yes^ No_Nr. _ 

rSl/SSDI Case Status 12-24 Not 

As;.ianed (S) Ves_No_NA 

Case Closure (S) Y,es_No_NA_ 

Exception tc economic 

neeo (RP) Yes_No_NA_ 

College Case requiring maintenance bcyonil 

^ years and tuition past W-t: underqr*^v!u" 

ate level (^RD) Yes Nc ^T^A 

Case Encumbrance Exceeds 

S10,000 . (RD) •Yes_iiO_NA_ 

Out-of-State Physical 

Restoration . (CO) Yes_No„NA_ 

Case Encumbrance Exceeds ^ 

S25,000 (CO) Yes_No_NA_ 



The following corrective action needed: 



By Date 



Corrective Action has been completed Oa^e 

Supervisor's signdture 



Remarks : 
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VII. Counseling and Guidance (Status 14) 

Was Counseling and Guidance (Status 14) 

. provided ' Yes^ No_ 

Were Specific Problems and/or Counseling 

Goals Identified Yes No 

Was evidence of counseling 

recorded Yes No 

Did Counseling and Guidance Contribute to 

Vocational Adjustn>ent of Client Yes ^No 

Summary Rating 0 1 2 3 4 NA 

VIII. Physical or Mental Restoration (Status 16) 

Was Physical or Mental Restoration 

Provided Ye^s ^No 

R5-B Completed Properly Yes ^No ^NA • 

Authorizations Conform to Fee 

Structure Yes lio ^NA 

Were Progress Reports Obtained Yes No ^NA 

Did PR Services Contribute to .the Vocational 
Adjustment of Client Yes ^No_^. 

Summary Rating 0 1 2 3 4 NA 
***************<********** 1,1,1, 1,1, 1,*** 1,1,1, 



Was Training Provided 


.Yes_ 


_No 


Type 






Tuition Fees Conform to Agency 






Policy 


Yes. 


_No_NA 


Training Progress Reports 






Obtained Regularly 


Yes_ 


_No 


Were tools, equipment, books 






or supplies provided 


Yes_ 


_No 


If yes, were provision of these 






services justified 


Yes 


_Mo 


Did Training Services Contribute 


to the" 




Vocational Adjustment of Client 


Yes_ 


_No 


Summary Rating 0 1 2 3 


4 


NA 



Was Maintenance Provided /^'iequate 
to Meet Client', Needs Yes_No_ 
Was Amount of Maintenance 

Excessive ^ Yes No 

Sumnary Rating 0 1 2^ 3 4 NA 

XI. Transportation 

Was Transportation Provided Yes No 

Was Need for Transportation 

Documented Yes Ho - 

Was Transportation Provided Adequate 

to Meet Client's Needs Yes ^No 

lias Amount AllcTwed for Transportation 

Excessive Yes Ho 

Summary Rating 0 ^ 2 3 4 NA 

★★★★★ifr ★★★★★★★★★★★★★★★ 

XII. Counselor Supervision of Case 

Case Moved Through StatusNWi thout 

Undue Delay \Yes Ho 

Were Proper Statuses Used Yes Ho 

If no, explain \ . 

Was Monthly Contact Made Yes x No NA 

Was Quarterly Contact Made Yes_tlo NA 

Is Case File Arranged as Per \ ^ 

Policy Yes No • 

Summary Rating O V 2 3 ^. NA 



Ho XIII. Case Recording 



Were, other VR Agency Forms Property 

Completed Yes Ho 

If no, which one ^ 

Is IWRP Completed'Adequatsly ''ejr_No_NA_ 
If no, explain 



X. Maintenance 



Does Case Rc-cording Clearly Document 
Pertinent Facts and Justify Services 

Yes_No_ 

Summitry Rating 0 1.2 3: 4 NA 

<^ 4^A**j^ifr***************ifr**ifr**'*r*AAAA**A«A^i Aa'iI 



Was Maintenance Provided 
Was Need for Maintenance 
Documented 



Yes_No^ 
Yes No 
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VERNON M. ARRELL, COMMISSIONER . 
April 30, 1981 




Ms. Susan Stoddard. 
Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms* Stoddard: 
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VICE CHAIRMAN 

Jack B. Dale. Jr. 
SECRETARY 

Murray Watson, Jr. 
John D. Simpson. }r 
AnneR.R^ce, M.D 



We are pleased to forward an assortment of materials utilized by the Texas 
Rehabilitation Commission for quality assurance and the avoidance of undue 
delay in the provision of rehabilitation iservices to clients. 

I 

"Quality assurance" and ''undue delay" ai;e such nebulous terms that they are 
not addressed directly by our basic Rehabilitation Services Manual. However, 
a whole body of practices and procedures has emerged in the 12 years since 
TRC became a separate agency which are intended to address both quality and 
non-delay of service delivery. / • . 

The basic responsibility for case management and non-delay is assigned the 
individual VR counselor (Atch. 1) . The unit supervisor. Region program 
officer, and Regional Director aid, /direct,^ and monitor zhe counselors in the 
performance of their duties (Atchs. 2, 3, and 4). One individual (supervisor) 
and one Central Office unit (Program Audit) have recurring responsibilities 
for formal inspection of counselor work (Atchs. 5 and 6) . A staff of Program 
Specialists^ experienced in a variety of the disabilities , provides direct 
support, guidance, and assistance to the counselors ' (Atch, 7) while at the 
same time observing the quality ^of casework and any delays which may have 
occurred. 

The Information Services Division at the Central Office produces a series of 
printouts for management at all levels, each designed to enhance the quality 
of services and to avoid delay* These documents include the Client Master 
List (Atch. 8), the Time-In-Status Report (Atch. 9), the Attention List 
(Atch. 10), the Supervisor's Composite Report_(AJ^hj^l^l^)^, and (for Program 
Audit only) a list of Clients With Date of Referral Over '60 ' Months Old 
(Atch 12). Sample pages from^ each of these documents are attached, with 
client identifying data removed. Information Services also has an extensive 
edit system (556 items) which prevents the computer from accepting Client 
Master Files of Changes or Requisitions (purchase orders) with erroneous 
input data, as per the enclosed sample pages (Atchs. 13 and 14). 
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STATE OF TENNESSEE 
DIVISION OF VOCATIONAL "REHABILITATION 
TVTC QUALITY ASSURANCE 
CASE REVIEW FORM 



Key to Sunwary Rating 

^« Excellent 

2. Good • 

3. Acceptable 
^. Poor 

5. Unacceptable 

NA. Not Applicable 



CHant Nane 



Training Center 



_• Referring Counselor 
Reviewed by 



Status 
Date 



I. Intake Information 



IV. Provision of Services 



Ccuncalor's Page 
R-2 Completed 
General Medical 
Sp;jc1alist Examinations 



Yes No 
Yes~llo~" 
Yes'~ho"~ 
Yes~l^o~l^A 



Su^T.ary Rating 1. 2, 3. t, 5. NA 

**^V*y.*T»'*******************************TV ****** 



11. Vocstional Appraisal 

Plan of Evaluation Developed 
Approprlats testis Administered 
Clisni: problems identified 
Client Interests considered 
Frcgrsw manaoer designated 
All documents signed 
Evali;ation suimiary in file 
Oob tryouts used 

In Center 

In Ccr.inunity 

Suinnary Rating i. 2. 3. 4. 



Yes_No NA 
Yes No 
YeslJo"" 
Yes~~No_ 
Yes No 
Yes~l<o__: 
Yes~^o_ 
.Yes_No___ 
Yes No 
Yes"n^o~" 



5. 
« 



NA 



in 



Adjustment Services 



Plr.n of ddjustnent Indicated Yes No NA 

Pl^n of adjustment developed Yes No 

Pr cbl:?inn discussed with client Yes No 

W-^r*?i Identified services 

Drovlcied 
•Pro^r.in rnancger designated 
A*r/ uocunonts signed 
^ vx-^ry progress reports sent 

to counselor .Yes No 

IKy^ quarterly R-ITs in file' * Yes No"" 



Yes No 
Yes~lJo;; 
Yes \\o 



SuFiir-jry Rating 1. 2. 3, 4. 5. NA 




Justification for services In 

file Yes_No_ 
Evidence of community resources 

solicited as needed Yes No 

Proper use of statuses Yes ^lo 

Completion or agency forms 

adequate Yes No 

Does case recording clearly 

document services provided 

by center Yes No 

Case folder arrangement 

adequate . Yes No 

Surrmary Rating iv 2^ 3. 4. 5. na. 

Complete only^ on closed cases 
V* Placement and Folla^-up 



Closed rehabilitated 
If no, give reason 



Yes No 



was thare evidence center staff assisted 

client in placement Yes No NA 

Employment at closure n— 

Weekly wages st time dosed - nA 
Evidence canter services contributed to 
rehabilitation closure Yes No _NA 



Evidence client contacted follcv;ed 



60 d^ys employrrent ' 
Discharge summary signed by 

supervisor 
Justification for sheltered 

closure 
Sheltered client program 

reviewed annually 

Summary Rating 2-. 3. 



•Yes_No_ 
Yes_No_ 
Yes_No_NA^ 
Yes No NA 



NA 
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Ms. Susan Stoddard 
Page 2 

April 30, 1981' 



The most formal of all reports are produced by Program Audit which in the 12 
months ending October 31, 1980, had examined 4,675 cases, nearly 5 percent of 
the total clients served in FY 80 (100,254). The entire audit of a caseload 
is directed at quality of services with particular attention devoted to 
possible undue delay through examination of any large numbers (34 percent of 
caseload, or above) of cases in applicant status; all cases in status beyond 
12 months, and all active cases 60 months or more since referral. 

So, as you can see, the provision of quality services to clients and the 
avoidance of undue delay are matters being attended to by various individuals 
and groups of individuals within the management chain and not entrusted to any 
single individual or single' group. 

\ 

I hope the materials enclosed will be helpful to you in your project. We hope 
also that the final product of Berkeley Planning Associates will result in an 
improved, uniform method for all rehabilitation agencies to utilize in the 
pursuit of quality VR services. 



Sincerely , 




Vernon M. ArreTl 
Commissioner 



VM:EJF:sm 

Attachments: 1 thru 14 
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ATTACHMENT 6 ^ Jj^ 



Corrected Copy 
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inTroaucuon 



The Program Audit Division is. assigned to the Office of the 
Commissioner. The Division Head receives instruction from and 
reports directly to the Commissioner. At wr i^^^ 

division is comprised of a Director, gflSja^^ Mur>,rcfa, 
and a secretarial support section of members. The audit 

teams are responsible for program autiit activities at all . 
agency locations throughout the. state of Texas. 

Audit team members are selected on the basi^ of fact-finding 
and analytical ability, report writing skill; plus demonstrated 
characteristics of maturity and objectivity. While sometimes 
beneficial, counselor experience is not an essential - prereqifi- 
site. However, former counselors have been assigned to the^ di- 
vision in the past, are presently, and it is anticipated there 
will be counselor representation in the future. 

In the conduct of their work, program auditors are guided by 

the fact that they are performing a staff function. It is, 

therefore, inappropriate for them to make decisions .of issue ' '"^'''''^ 

directives concerning the administration or operation of any ^ 

program* | 

The purpose of this publication is to acquaint all personnel 
with the function and scope of Program Audit. It is not in- 
tended to describe detailed methodology, but rather to set 
forth in general terms a description of the' activities which 
will be observed by field personnel. j 

■ . ! 

• ?ilthou<3h tJie procedures and forms referenced in this pamphlet . . 

may experience minor changes in the future, it is anticipated 
that the basic audit philosophy expressed herein will\ remain 
relatively constanz thereby negating the necessity for changes • " - 

or revision. ^ 

■ program audit division activities 
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The Program Audit Division has the responsibility to engage in at least eight 
distinctive types of audit. 

1. Routine Audits 

These are customary, regularly scheduled examinations of the 
administrative and operational activities of any TRC office designed 
to measure quality and effectiveness in the delivery of TRC services. 
The focus of attention in these audits is' the record established in 
individual cl ient case folders. 

2. Special Audits 

These are nonscheduled, irregular audits of any TRC activity, usually 
requested by someone with line authority, to determine facts relative 
to a given problem or area of concern. The activity of the audit team 
may vary, depending on the exact nature of the audit, but usually in- 
cludes an extensive eAafnlnAJ^lPli Pf ^^^^ folders and other agency records. 

3. Facility Audit / 

These are unscheduled examinations of state and private facilities 
serving TRC clients, accomplished on request, for the purpose of de- . 
termining quality of services. 

4. Spepial Investigations ■ _ 

These are also unscheduled, special inquiries accomplished on request-, 
to determine the facts concerning any legitimate TRC interest or matters 
Q relating to internal affairs. 

231 ■ ■ 



foreword 



It IS our conviction that the best way to insure quality 
services to the handicapped citizens of our state is to 
have agency policy clearly set forth in manuals designed 
for use by those who have responsibility for the delivery 
of rehabilitation services. We seek constantly to improve 
our systems by continuously soliciting suggestions from 
those-persons affected by, and responsible for, imple- 
menting existing policy. We test the effectiveness of 
our methods by frequent and various examinations. 

Program -Audit is a staff function designed to insure that 
published policy is being carried out. Audit activity is 
accomplished by means of case folder and ancillary 
records examination which tests the integrity of the 
record and the conduct of affairs within the Commission. 
Audits are. carried out on a random basis a$ well as upon 
request by supervisory personnel in special instances. 
All Program Audit work is reflected in formal reports 
which provide a basis for evaluation of the manner in 
which our personnel are performing their duties and 
which enable supervisory personnel to pureue such courses 
of .action as are indicated and appropriate. 

1 



Progrom Audit represents but one aspect of the on-going 
effort to provide continuing statewide studies and program 
evaluation. Other agency divisions regularly involved in 
this shared responsibility are the Research and Statistics 
Division, Internal Audit Division, Planning ond Technical " 
Programs Division, Facilities Division, the Progrcrn Specialist 
Staff, and individuals with management responsibilities 
ataXL-ievelsT' In combination, input from alLthese depart- 
ments enoble me to monitor . and judge the well-being of 
the Commission, > • 

Ail personnel are encouraged to view Program Audit as a 
supportive activity which, when properly heeded, leads to 
higher efficiency, greater prb'fessionalism, and improved 
service to our clients — which should te the constant goal 
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by a purely random method- The regular sample size consists of ten active 
cases, although a greater number may be chosen under special circumstances. The 
sampling method does not preclude the sel ection of. cases which also appear with 
one or more asterisks on the Attention List, but-'it is to be emphasized that 
such cases appear as a result of the "luck of "the draw" and not because they 
were especially chosen. 

An examination is made of the travel vouchers submitted by the counselor 
controlling the caseloads to be audited for the purpose of identifying those 
clients whom the counselor contacted. The case folders of those identified are 
later called for at the District Office to determine if the required correspond- 
ing entry has been made in the client case folder* 

The various data collection instruments employed by the audit team are assembled 
and the team is^prepared to depart for the field- 
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DISTRIBUTION OF ACTIN/E CASES INDICATING BALANCE 



PRE'SERVICE 



STATUSES: 02 + 06 + 10 + 12 
Rcf: Time-ln-Status Report 



(SUPVR - VRC) 

IN-SERVICE 



14 + 16 + 18 
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-l/jhe balances reflected hereon are not to be considered 
rigid and may vary by type of caseload and tinne of year. 

PAA-I 

Revised 9-I-77 



POST-SERVICE 



20 + 22> 24 

Legend: 



% 
ICQ 




.Current Balance 
■ Ideal Balance 
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5. Surveys 

' These are irregul ar on-site, wide-rangjng studies undertaken to determine 
adherence to standards or policy, and program effectiveness, e.g., post- 
closure surveys of self-employment enterprises. Status 26 closures, etc. ; 

6. Field Administrative Services Audits 

Audit of Field Administrative Services activity is ordinarily an integral 
part of routine audits, but may occur as a separate function to satisfy 
a particular need or in circumstances where a routine audit is in- 
appropriate,- e. g., at Regional Offices. 

7. Civil Rights Audits 

Civil Rights matters are also normally included as part of a routine 
audit. However, special independent audits may be necessary' to respond 
to specific complaints or circumstances relative to Equal Opportunity or 
matters of alleged^discriminatory practices on the part of private ven- 
dors or TRC employees. 

8. Analyses . 

Periodically, the various Central Office originated computer printouts 
are examined and analyzed for the purpose of acquiring statistically 
significant data which may identi fy problem areas where improvement is 
possible and necessary, e.g., Analyses of the Supervisors' Composite 
Report/Attention List. 



pre-audit activity 

The remarks in this section relate primarily to routine audits, however, similar 
activity will precede any of the various other audits. 

Whether internally scheduled or requested by competent authority,, certain 
preliminary information is assembled by the audit team prior to departure for 
the field. Through examination of the Time-In-Status Report, the balance in 
the individual caseloads to be audited is established ( p.9 ). No particular 
significance is attached to the findings due to the great variety existing be- 
tween the various general and special- programs . However, .extreme out-of-balance 
conditions in any of the Pre-Service, In-Service, or Post-Service areas may be 
indicative of existing or developing problems and may govern the direction the 
audit team takes in the audit. 

The Time-In-Status Report also serves to identify the statuses in which the 
cases in the caseload are distributed (p. 8 ) and the number of cases that have 
remained in-status over six and twelve months. This distribution determines^ 



for the most part, the number of cases to be Selected for audit from among the 
various statuses. The selection would not necessarily conform to the distribu- 
tion if, for example, an extraordinarily high percentage of cases were found in 
Statuses 00 and 02. The. best evidence of-the nature of the casework is to be 
found in cases that have advanced beyond these statuses. However, if the condi- 
tion described above is encountered, a separate examination of the. Status 00 and 
02 cases could be undertaken to determine the reason(s) for the condition. 

Once the number of cases to be examined in the statuses indicated by the 
distribution has been determined, the actual cases to be audited are selected- 
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used for each case audited and succinct entries are made of any observed defi- 
ciency in the space opposite the numbered items. The numbered spaces at the bot- 
tom of the PAB-4a are left blank in order to allow identification of additional 
areas of interest not contemplated in the regular course of the audit. 

In addition to extracting and documenting pertinent data, considerable copying of 
casefolder material may be anticipated. No particular sigm ficance; should be 
attached to this activity. Some documents may be copie^ to add to ,the store of 
similar documents being collected as part of a separate, on-going survey or analy- 
sis of an entirely different nature. Others are copied for their own particular 
significance. All copied documents or pages are cojisidered back-up material which 
reduces the necessity tojrely upon memory and may provide the base; for subsequent 
discussions with program managers at various levels. j 

i / \ 

The ten most recently closed 'cases in Status 08 will be examined to determine that 
case folder contents support the decision to/close the case and that the indivi- 
duals have been noti fiedi in writing of their appeal rights, whereiapplicable 
(Status 02 to Status 08)/. / i 

Fifteen of the most retently closed cases in Status 26. will be called for and 
closure information will be extracted/for follow-up by the audit {team. Normally, 
only the results ofLten cases will be reported. The additional five cases in the 
sample serve as alternate cases in/the event difficulty is encountered during the 
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the audit procedure 



In keeping with accepted, traditional audit practices, visits by the Program Audit 
team are unannounce^. '\^This is not done for any ulterior motive to surprise or 
embarrass the unit or individual staff, but rather to arriveand be able to ex- 
amine records and case folders in the condition they, would exist on any given day. , 
In fact, audit teams are instructed to make discreet inquiry before selecting a> 
caseload for audit to determ'ine if there are any legitimate reasons why it should 
not be audited at that time. 

Upon arrival at a District Office, the Audit. Team Chief informs the Regional 
Director of the team's presence at the location and asks if the Regional Director 
has any special interest area he would like the team to examine. As soon as practi- 
cable after arrival, the team meets with the Unit Supervisor and the counselors 
whose caseloads are to be audited, as a minimum. Other staff are invited to attend, 
if they have an interest and if their duties permit. The purpose of the meeting is^ 
to acquaint, or reacquaint, the team with the staff, to describe briefly the nature 
of their planned activity, to reduce insofar as possible the naturaV apprehension 
attending an audit, and to establish a comfortable, harmonious working relationship 
for the duration of their visit. 

Once a work area has been established for the review team, each member will normally 
request the ten-case, pre-selected sample from one of the caseloads to be examined. 
Auditors are not bound to this procedure, but it is the logical starting place mos.t . 
frequently used. The number of caseloads to examined will vary according to the' 
size of the unit. Normally two caseloads will be audited in a smaller unit and 
four or more in a larger unit. Several data collection instruments are used in 
the audit 'process. An important forni is the PAo-4a f d.12 ) . A separate form is 
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the audit report 

A fh« ;,<.Hit team begins immediately to prepare 
Once the inf.omation has been gathered f^^^udU team oeg ^^^.^ report is 

?he audit report. The ^l^P^^,J,i;^,!//?Sree w^^^^^^ ' two-caseload audit to six 
distributed ranges from approximately three weeKs 

for a four-caseload audit. , ^ 

'^^^ J *. =. ^ritiaue of their findings with 
The Division Chief and the 'fValized This allows the R^aional . 

have a bearing on the findings. - ^. „ thP 

... i-ict nf F^^ceotions preceding tne 
Oepartures from >9ency policy are "J f-J,;",,|„Vs are required to respond to 
ISrixfepSoirilt^n^rs Sr'ane^'re?;. of the report. . 
The audit report is a combination of narrative and araphic prssent^^^^^^^^^ 

r„5it ?eam findings fts P'-^» °"= l';"''5S^j =ated by completed PAA-1 and -2 forms, 
rases within the audited caseloads are ^f'Jjrll" -.'a^ Ire shown on a completed 

irrr^ofrorcrsroeVitc^^^^^^^^^ 

the report. 

of the report^^distrihuted « thl ' 
FHSriinl3ln^re"?"tfo^n! I'lioi^nro-^eniLt reproduction and Sharon, of 
the contents with the counselor involved.^^ 

-;- - cS?ies- oraldirre-;o-rts-are--al-s-o ^^^^^^^1^^^^^^ 
Slssioners. the ftssistant ?f"W/,°r^=| r3r,nd implement corrective actions 

°foTSfU?:Jc?Ss TrVelf rt ^d au^i t rep-^^ ^J^^X^f^- 

instances involving civil or criminal matters. 
■ The Profram Audit Division is P-«cularly alert to .-,=-if,^and^report «^m^pla.y 

casework to the CWissioner 0":^'J;3j|^°?ble counselor -can- be anticipated and 
. ^ir^ecoTn^t^Sn ^nriri^bSncrihe^drvelopment and career progression of the 
'individual involved. 
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follow-up process. Contact is established with the client and/or the employer to 
determine that the conditions of employment set forth on the Closure Contact 
Report (TRC-418) are accurate; that the client was .employed on the date of clo- 
sure, and was employed for the required minimum period. The audi t team will nor- 
mally respect the counselor's restriction if there are compelling reasons why a 
client's employer should not be contacted and those reasons have been documented 
on the TRC-418. However, under certain circumstances, such as wholesale, poorly 
documented restrictions, the audit team may make discreet inquiries in a manner 
that will not compromise the client for the purpose of verifying closure infor- 
mation. 

From time to time. additional ten-case samples will be obtained of cases closed in 
Statuses 28 and 30. . 

Copies of client services requisitions issued since the beginning of the fiscal 
year or within the last six months, whichever period is greater, are examined to 
detemine that none are missing; that supervisory approval has been obtained for 
those back-dated over ten days; to discern payments in excess of the Maximum 
Affordable Payment Schedule (I-IAPS), and to identify any unusual or exceptional 
trends or patterns of expenditure. 



A cursory ^i^^ii^ii^Iti^i s made of all cases in the~DTs^ncrTjm^that haveT^ined 
open in excels of five years for the purpose of determining that continued services 
are justified and that reasonable progress is being made in the rehabilitation 
process., - 
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An' after hours security check is., accompl ished to ascertain if appropriate care is 
being taken to safeguard the confidentiality of cl-ient information and that TRC 
property and supplies are secure in the absence of TRC employees. 

Selected areas of interest relative to personnel, purchasing and supply, and staff 
services are examined based on a checklist provided and kept up-dated bythe 
Assistant Commissioner for Field Administrative Services and the appropriate de- 
partment heads. 

Unit personnel are tested regarding' thei r knowledge of Civil Rightc and ^"^^.^^1" 
are examined to determine the scope and extent of acti vity^related to^Ciyil Rights/ 
Equal Opportunity training, recruitment, staffing, etc. The responsi bill ties of 
Program Audit in monitoring these activities are more fully described in the TRL 
Civil Rights Manual . 

Supervisory Case Service Reviews accomplished by the Supervisor in the last^two 
full calendar quarters are examined to detennine the adequacy of review, method 
of control, promptness of counselor corrective actiori Jhe Supervisor s system 
of follow-up. Patterns of recurring deficiencies are identified, where they exist. 

Structured interviews are conducted, as a minimum, with the unit supervisor and 
the counselors whose caseloads have been audited to permit the opportunity for 
their input. Other personnel may be interviewed if they indicate a desire or as 
may be appropriate to the circumstances. ' • 

Depending on the number of caseloads being audited and the 

the audit team may be' required to return to the office for a second v sit. Jhere 
y or : ay no? Te'an interval between visits. If .there is an interval t at time 
^will be used by the audit team to analyze their findings thus far to begin draft- 
• ing a report and to detennine what remains to be done on their return to the office 
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' May 29, 1981 



Ms. Susan Stoddard 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

This letter is in response to yours of April 6, 1981 concerning our agency's 
use of case flagging and .quality assurance techniques. The following is an 
item-by- item breakdown of the tools and techniques we currently use in monitor 
ing case movement and potential undue delay: 

• Case Flagging 

We do not have a computerized case flagging procedure at this time. 
The tools we use are as follows: 

• vTime In Status Report (attachment //I). 

We teach our supervisors and counselors to draw a line as shown 
on the attachment. Cases appearing outside of this line require 
explanation. This is not to say that a case outside of the line 
is necessarily being mishandled, but it. does require the counse- 
lor and supervisor to discuss why the case has been in status 
so long. . 

• Masterlist (attachment //2). 

This is used in conjunction with the time in status report. 
The information available is generally well known and self 
explanatory. ' 

• Area Supervisor Case Reviews. 

'They are required to review a minimum number of cases a month 
to assure both technical and service delivery quality. 

• Management Review Team. 

A team of rehabilitation supervisors who, on a periodic basis, 
review cases in a region of the .state to assist in assuring 
quality control. 
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utilization of audit reports ' 

As with any audit or Inspection report. Its value lies In 

the use to which It is put. While the Program Audlt^ \ 
Division has no authority or control over the uses of the 
reports Ir produces. It is anticipated that where weak- 
nesses are Identified positive action will be initiated to 
correct the condition and prevent recurrence through 
training, staff development, or other appropriate means. 
And, where strengths are identified, the report can be 
utilized to encourage continued quality performance. 
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Ms. Susan Stoddard 
Page 3 

May 29, 1981 
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• Caseload Inventory . \ (attachment //9) 

A reference document Vhat shows the make-up of a caseload 
by disability group am^ status, 

o Rules Of Thumb: 

o A contact with any case atXleast every 90 days 

• 30% or less of the caseload statuses 00 and 02, 



The agency is in the process of converting tC5 its own computer and this move, 
will expand its capabilities to more efficienVly monitor caseload management. 

Also attached is a copy of the partic:. . ? ive Mariagement-By-Obj ective system that 
we use with VR Counselors and Supervisors. This\ material is somewhat dated but 
it gives the basics of the results-oriented system that we use, (attachment //lO) 

if you need more material or explanation, please do not hesitate to call on us. 



^ / 
\ } 



Sincerely, 




Terrell I. Murphy 
Supervisor 
VR Field Services 




TM/csm 
Attachments 
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'Ms. Susan Stoddard 
Page 2 

May 29, 1981' 



• Quality Assurance 

Many of the items mentioned above, and: 

• Quality Assurance Training. 

Our Area Supervisors received the J.W.K.* Program in 1979 
to heighten agency awareness. 

• Federal Case Review Schedule. 

All supervisors are trained in the use of the Case Review 
Schedule (formerly San Diego Case Review Schedule) 

• The Program Evaluation Unit. 

This unit is constantly doing studies to assess the quality 

of our service delivery division. The last five study topics were 

• Study of Utilization of Similar Benefits 

• Study of Variables that Impact on Employment and Income of 
Legally and Totally Blind Rehabilitants 

• Study of the Use of Personal Skills by'Blind Persons 

o Study of the Use of Low Vision Services and Facilities * 

• Study of Counselor Responses to Medical Abnormalities 

• Chapters 2 (The V.R. Process) and 18 (Standards for Service 
Delivery and Case Recording) (attachment //3). 

These two chapters speak to the issues of proper -process . 

Our entire V.R. Manual has been redone in the last year-and-a-half 

using the Information Mapping style shown in these two chapters 
and our staff find it very easy to. read. 

• Supervisors Composite Report (attachment //A). 

This report shows key case flow data for an entire area to help 
monitor trends that will help the supervisor know what area(s) 
to emphasir^e with staff in general. 

• Supervisors Cumulative Report (attachment //i3). 

This gives the supervisor key data about the various caseloads 
in an area allowing for' more detailed analysis begun with the 
preceding form. 

• Monthly Case Service Expenditure Report (attachment /;6). ^ 
This allows the supervisor to easily see exactly where a VRC 
is spending money in any given month and on which clients. 

• Case Ser^lrices Cumulative Expenditure Report (attachment //7). 
This enables the supervisor to readily see the major items on 
which 'each counselor in the area is spending during the year 
and gives an areawide total. 

• 26 Closure Report (attachment //8). 

With this, the supervisor and counselor can, on a monthly basis, 
assess the types^of closures on' a "caseload, their cost, and 
other pertinent data. 
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250 EAST 500 SOUTH STREET • SALT LAKE CIT)\ UTAH 84111 • TELEPHONE (80ir533'543/ - 



April 24, 1981 



: .:ter iir . ■ ' 

Th cur : i ;tie^*ated . z^-'^ r 300 and monthly update by the 
counselor. A new coihHuuer print uul of the master list is sent to each 
counselor once a month. From the master list coordinators, supervisors, and 
counselors can quickly review the statuses of their cases by name, referral 
sourcf^, months in status, and severely disabled designation. This document 
also :iives information as to SSDI/SSI allowed or denie.d status. Cases that 
are in statuses beyond a specified time are then reviewed and action taken. 
This computer produced document is the most accessible printout to measure 
problems and concerns of specific clients in any given caseload. This also 
prints out closed cases by status which then is compared to their progress 
as projected by each counselor for the year, / 




STATF, SL'rLHIXTEXPi:XT OF t^UBUC ISSTRLCTIOS 




Attached is a copy of a master list. 
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HARVEY C. HIKSCHI. Admm.VotO'^ 
Ot«ivon of PehoorM'ortO'^ Se»«"cei 



250 EAST 500 SOUTH STREET. • SALT LAKE CITY, UTAH iS-flll • TELEPIIUS'E (mii 5.^3-5431 

' UTAH STATE OFFICE 
OF EDUCATION I 




W'ALTEH A TALHOT 
STATE SVPERISTESDEST OF niUJC I\STHL CTJOS' 



April 24, 1981 



\ 



Susan Stoddard 
Project Director i : 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 




HARVEY "cTih^ Administrator 
Division df Rehabil itation Services 

ac 

Attachments 



Dear Ms. Stoddard: 

\ 

Enclosed please find information requested by your letter dated \ 
April 6, 1981. I believe that this information is self-explanatory. 

In addition to quality and quantity control, we conduct periodic 
caseload reviews by coordinators, supervisors, counselors, and our 
evaluation specialist. I am sure you are aware of the state and 
federal administrative program reviews that are conducted which 
aids us a great deal in taking an objective look at our procedures. 

I hope this information will be useful to you, and if we can be 
of any fui;^ther help, please let us know. 

Sincerely, ^ 



EKLC 
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HARVEY C. HlRSCHU Ac'n.n.vtfcw 



250 EAST 500 SOUTH STREET • SALT LAKE CITY, UTAH ^Ull ' TELEPIIOSE (801 > 5J3'5hl 

J0 ' 



UTAH STATE OFFICE 
OF EDUCATION 





il 24, 1981 



tt'AircH n Talbot 

STATE SUI'LRlSTllSnnST OF'I'UliUC ISSTRLXTIOS 



MEMORANDUM 
SUBJECT: CASE FILE REVIEW--DRS-19 



Client identification is made from a computer sample on a random 
basis which is sent to the district supervisors for case review each 
month. The form is completed by the supervisor and counselor with copies 
appropriately distributed with the original being sent to the state 
office. This information is compiled on a district level by percentages 
with the report then going back to the district supervisors. General and 
specific trends can ;be identified as to the adequate services being 
directed to clients so identified. 




HARVEY C. HIRSCHI. Ac^..t.\»»o»or 




250 EAST 500 SOUTH STREET - SA LT LA KE CITY. UTAH H4III • TELEPllON E (801 h533-543l 

UTAH STATE OFFICE 
OF EDUCATION 




WALTER D. TALBOT 

April 24, 1981 state svpi:RisTi:snEST or ruBt.tcissTHVCTios 



MEMORANDUM 



SUBJECT: QUARTERLY CUMULATIVE STATISTICAL REPORT 

This document is generated from the R-300 and the update of the 
Master List. This information is sent to the field where district 
supervisors and counselors can compare their caseload functions not only with 
their own progress, but with their colleagues, district and state. 

This information is used by the supervisor and state personnel for 
selected caseload reviews in identified areas of concern that are 
printed out by the computer. 




2,4 c 



HARVEY C. HIRSCHI. Admm.itfotof 





State of Vermont 



Commissioner's Office 

Alcohol and Drug Abuse Division 
Dinsion of Sernccs for ihu Blind 

and Visually Handicapped 
Social Scr\iccs Division 
Vocational Uchabilil'iilion Division 
Disability Detcrtninalion Unit 

103 South Main Street 
Water bury, Vermont 05576 



l)KPAkTMI':NT or SOCIAL AND IIKIIAIULITATION SKUVICE^ 

AGENCY OF HUMAN SERVICES 

Main Officer 
Osgood BuUdiuj 
Vermont State Hospital 
Waterbury, Vermont 05676 



April 21, 1981 



Ms. Susan Stoddard 
Project Director 

Berkeley Planning Associates ' - 

3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: 

This is in response to your recjuest for materials regarding case flagging 
and quality assurance procedures. Enclosed for your revie\>^ are the various forms 
utilized to facilitate these monitoring processes. These reports are subriitted 
on a regular basis and progress (or lack of it) can be readily identified. 

In the Casework Requiranents series, certain conditions have to be met 
before a status change can occur. Before a counselor can effectuate a status 
advance for any client, the Requironents must be reviewed and signed by the 
supervisor. In addition to the above, I have included a copy of our Manual's, 
Table of Contents, in the event you might want additional information on a specific 
subject. 

I hope that" this material is useful to you. Please feel free to contact 
me if I can be of further assistance. 

Respectfully, 

TJavid M. ^entasti 
Director 

n-r-l:ag 
Enc. \ 



ERIC 
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DRS-19 (e/79) UTAH STATE BOARD OF EDUCATION Review Date_ 

DIVISION OF REHABIMTATION SERVICES 
REPORT OF CASE FILE REVIEW 

See Case Service Manual Appendix F for detailed instructions. : . ,/ 

Review Codes: 1 - Coordinator; 2 - Supervisor; 3 - (other) 

Status Tine in Status^_^ months 

District No; Counselor No: _ Client No; i 



1. Application complete/signed J__ No ^ Ves 2. R-300, Case Service Report in file 4" T T y" 

3. Adequate diagnostic records in file . Ji. "° J- J^^ 

4. R-31, Disability Coirsultation, complete/signed ^ ' 

5. R-62, Certificate of Efi^ibility, coinplete/signed 

6. R-62a, GSI/SSDI Selection Criteria, complete if appropriate 

7. R-U, and R-300 Case appropriately classified as SD or r,cn-SD. Roviewor comments : 



_l_No J_Vc3 
NA J_No- _2_Yes 
1 No 2 Yes 



8. R-4a and R-48' complete/up-to-date, if appropriate . , — 

9. R-11 entry relates client's disability to substantia] vocational handicap through a diagnostic statemiir.t 
of the handicap, 'and, a description of client's functional linitations ? Reviewer coments: 

10. R-5 IWRP completed and approved with current amendments, to include 5a and 5b as appropriate. 

11 R-5 and R-U, Is Client's vocati onal cioal (IWRP) cor^ patiblc with diagnostic studies , ^dical consultant 
rccorondations , job -^arketlomands, Client interests, etc. and ]ustificd by R-11 entry detailing Counselor 

12. R-5^and R-U, are IWRP intermediate objectives measurable , and is there (R-U) evidence that the objectives 
have been monitored and amended as necessary? Reviewer coments ; 



0 NA 1 No 2 Yes 



_1_ No _2_ Yes 

J^No J_Yes 

J_ No X Yes 

1 No 2 Yes 



1 No 2 Yes 



13. R-5 and R-U, Has action been documented of Counselor effort to seek similar benefits (if appropriate), when 

DRS funds are" utilized? • , . i « ms T" T voc 

14. P-55 (or letter) , Has information been shared with referral source (s)/cooperating agencies as a pr ± NA l N 2 
\,\ Are progress reports (vendor, service agency, training, etc.) m case file complete and up-to- te? T N T 
16. R-U . Fr eouenc v of Counselor-client contact and timeliness of status movement. Reviewer coronts : 1 Inadequate ^Adequate 

: n.^.n;,.Hnn/.nnf,nf nf n.s. folder. Reviewer counts : J_Inadequate ^ Adequate 

19 Reviewer's iudqment of overall quality of case management. Reviewer \ . »u ^ ^ 

ib, Keviewer juapent ut ^^^^^^^ ^ Acceptable 3 Above Standard 

coniT.onts: — — ' 

■ ■ .1 . . . 

. '. . L> " 1 Inadequate 2 Adequate 

19 R-U's Initial interviews, contact reports, etc. . , — ^ — 

20! Are receipts- of equipment/prosthetic appliances, restoration checklists, etc. m case file, ^ ^ ^ ^^^^^ 

as appropriate? , ' n NA 1 No 2 Yes,'''^ 

7U Has aoorooriate action been taken regarding reusable equipment? ' .. ■, . l, "T „ <rT.i,i«,mr- 
om t i teRcview^ 1 Continuous monitoring of case activity until acceptable performance is achieved , 
22. Kccommenaau n \ T Case to be followed up by supervisor in _ days 

\ 3 Routine review . ' • 

r , 249 . 

^""-iewer's signature ^ ' 



(XX^ISEUK:- . 'mi OnaCEt REWRTING PEPIOD:; 



BWs to Lxj va-ittoi by : 


Cases to be; closed in status 26 by ' • ' : , 


Client's Ncuno -, 




Client 'r. HcTC - 


tontli - ■ 


1. 


1. 


1. 


1. ■ 


2. 


2. 


2. 


2. ; 


3. 


3. 


■J 

j> 


3 


4. 

1 


4. ^ ■ 


4. 


k. 


5. ■■ • 


5. 


5. 


. 5. 


6. 


6. 


6. 


'6. 


7. 


7. 


7. 


. 7. ■ ■ • ■ . 


8. . ■ 


8. 








9. 

v_ 


Cases to be closed in status 28 by 






i. 


i. ' . 


rases to be dosed in status OB by : 


2. 


2. ■ 


Client's Name - 


i4ontji - 


3. 


3. ■ 


1. 


1. 


4. ■ 


4.. ' . 


2. 


2. 


5. 


■ 5. , , • 


•3. 


3. 


6. 


6. ■ . ; 


4. 


4. 


1, 


7. '■ . 


5. ■'■ 


5. 








6. 


Cases to be closod in status 30 by : 


7. ' 


7. 


1. 


1. ■ 

J 


8. 




2. 


1. : ' 


9. 


9. • . 


3. 


3. 


0. 


10. 


4.', 


4. . \ 




♦ 


5.,;" 


' ' 251 






6. . 








7 ' 












ERIC 






Supervisor's Signature 







Agency of Human Services 
Department of Social and Rehabilitation Services 
VOQ\TIONAL REHABILITATION DIVISION 
Waterbur>^ Vermcnnt 

MASTER LIST OF CASES 
(Individual Case Progress Slieet) 

Counselor ' Tally No. 





Current Status 




Closure 
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Vihsn clcsir.g tha cas^ Li 03 cr chancinc the ^ar^s frc:tV-52-10 cr C6-10, s^, 
will cxpi2\ui tl:-Ls fern and" at^ch .it to z^^ csrtliic353 of ellgihlUr/ cr clcsura 

Cfeceidir.g u^cn the c3se acnicn, fo:m shjculd.be ccrolscad as irjdicarad belw. 

00-08 1 - S 

02 - 08 1 - 15 

06 - 08 1 - 23 

02 - 10 9 - 12, IS - 19, 24 ■ 

06-10 9 - 12, 17 - 22/ 24 

E>S)lanat:icn of 

^2. >feet:ing ar.d review wi::ii th-a clianr/rsferral ard/cr r^resanreri-.^ 
disa:ssicn crier to the clcsure acticn, except vi:s:: 

a* Ti:*=^r° is evidence in the record to siisr^ntiars ccuiseiers eifcres to arrrr.cs 
acccLitrsnrs (dc least: f/.o li^rtars) issuL-^g cr r-r . - -r ing ai:ccir-:=ren::3 , -iiich 
a^B ncc '<e^ srjd th-ere is no respcnse, ^ 

b. The client/rBferral by c^n writrten stisrsrsnt. or by thar c: a ^ecal r2?r3£en"t^vj.%'e 
refuses the cLscjssicn. . . . -i.-. 

c '^e clie:c/referral or recerser.t^tdMi, requests thje clcsur3, izi wr:.-ting cr ^-^e — e^f 

d 'i-lers are intar-'eninc reasons whicr: 'Miruld 'naka sui: a rreetinc irrrac:iicle cr 

inrx::ssible; 1. diedr2, roved cur cf state; 3, unable to contact; 4. instituticn- 
allzed and ix^^ailable; 5. ether re-scns 'si=Llar to thjs afcrsrentioned- 

e In e\^rv ir-stanoe -where intar-;^aing reasons ctr^ than ceatn pre^.-nnt a raetmg 
^jd discussion v^th ^e clierrt/refarrai or reor^sentati've , a letter -vill s^X 
inforrdna of richt to re-co^^card-tion/H?ieal if it is so cesired. {?lsc, a 
copy to referral sccrce or ether ercrcpriate individuals-) At least 3.^>^xs 
advarjoe ncxice should he gi^^-. 

46. Applies cnly to clis:t recei'/ing ScCI/SSX benefits at tirie of clcsure, 
47,15. Ciedced according to type of closure action. 

.• ai3. caterrdnaoicns of L-eligihility rray be based cn factors^ cf no disabling ^-"-^—f^- 
no vocational r^-dicap, handicap too_se-^, or " ^ 

is closed handicap too se^-^ore, 
r^'/ie'.^ after closure^ 




42,3. If client h^ no rental or enctional disorders thJ^ 
checked net applicable (N/A) • . 

415, If sp^alty exannJiations and/or e^-aluaticns -.^re necessary itis'-^culc be 
checked rot apFli03ble (IVA) . ^ 

secticn -'^tes/ Ccnir^.ts" is to ba used by -he superrlscr to ncte r-rarks 
relatl-g to the for ccrr-ctiv- acticn or additional inforretion to r^et tne case- 



Special Scoe 

Supervisors are rot ^ ^-cn ^j._s ^^^r^ySLd -his ard 

n^.ts. If ocrrec::icns or seditions are r^ecessary tr^ super.-^- s-i::u.c ^ — -.u 
renum to the counseicr, unsicned. 
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\ 



CO - 08 CJ ^ - 3 



02 - 03 rj - - 



- ' C6 - 03 / / 1-23 




2 /~~7 "tLcr to clcs->r:e acxia: -zza basis vas 

parsnc cr guardiar-. /_/ , 

3. n Lector sar- to ref erraVcli^^ ' L-^r^;^ 

4 /—J La-csr se-.t to referral scx:rzs. L-.cica^-g 
reascns fcr dLc^ ar-d closxire act^- 

t — 7 ^°'~al is xacs to ccher acer-cies as 

accrccnare , co^-ac:: — g ■ ^ 

a^.c} and fcr^ardir.g of racsssar/ 

5^ / 7 353 coa^rsr.w dcnclered. N/A / — / 

7. /-7 3^300 is cnrplered 00 - 08 ^^^-j 
— iiiforracicn correctly ccc£-d- N/A /_/ 

3. r~7 Clcsv:re r.arra:^ive; cc-pl2::sd and stati--:? 
cxunseicr's basis for dcinire. 

9. /-~~J irclicacion ccrnletad-and sis^ec. 

^0 /—J initial -^^is^ co-^le^.-'.-iedn 30 
^ da'/s of client signing arplicar^cn; 
cbse:r.-at:icns , rsdicaVrSyc="-clcg^^ 
hisncr/ , erplcN-ranc his^ry . '^^-"^ 
cciecrlv-B, educatiicnal hisTxry , =«:^-/ 
-' - -^iv Hi^rorv, clients ex- 



15. £T ft.3C0 is ccnplated 02 - C8/ Clcsur2 
ir-fojnraticn correctly cccea. 

\N/A rj 

17. / / Gener^ xedi 



a1 -L 



iltsd end 



13. /""y Psycro'lccical, csycr^zric 

tians are. cbtiamec i- spcHcarri 

ssiral or CTCticnal disorder. 



19. / 



ceciuKiions frcn VTR and counseicr act — ^• 

' reqv:£s^:ed and/or ammcr^nec. 

V2 /"~7 L^rlcencs that ccals of e.G nexr resr 
i — •' discLzsse^ •</ith client. 

13. /I7 2i?v^:-^,j£^fi.g^lSS ^^r 

ik"SlcibiIir/. /~~7 



■y 



■; a\ *-v exscinaticns and/cr . _____ 
evaluaticri •v«^re cctained. N'/A /__/ 

20. /T Carrificaralof eligibility for _ 
extended e'/aluar^cn is coxiezea a.. 

signed by ccunsalcr and s;=er-/iscr. 

21. /-7 E:cter.ded e.-a.--.uaticn -^^^^j^T^^ 
cijecci^-es ar-d ser-.-ca^ 

, and a narrati'.-e Lncl-^ng tr^ 

basis for Excsrxa^i e\'al-^^cn end 
beiej:ar:<s to bejeached to car- 
eraine feasibility. 

22. n Prograss in e:<-^xed avsiuati^ 'J- 
eval^^::ed according to ^■•-^ 

least every SO daira. 

23. 3^200 is ccnr:leii3d CS -_Oa,clos-^ 

24 • /~7 Cartificaca of a2J.<=ibilit:/ li 

^ plet-d and 3icr.ec ccxnse-c^ 

and super'/i^cr. 



14. / / Cartiificara of in 



and s^cr.ed. N/A / / 
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Wher^ writing any Individualized Written Rehabilitation Plan (IWEP) 
tiiis for.n will be^ cxxroleted and attached to part 2 of • the IWRP document. 

Depending upon the type of plan being written, Vocational or Extended 
Evaluation, this form should be ccnpleted as indicated belcw. 

10-12 1-3,5-9 
02 - 06 ■ 1-9 



•Note 



Cases in which a plan for Extended Evalviaticn and Vocational Plan 
are written will eadi have a separate form attached to the. IWEP document. 

Explanation of requirarents with not applic^le, (NA £17) , designaticn. 

#l.b. As this requirerent deals with a vscational direction it will 
apply only to vocational plans. Esctendsd Evaluation plans 
would be checked not applicable. . ■ \ 

#3. This requixesnmt deals with vocatioial goal. (See above) 
*6. Afplies only to SSDI/SSI cases. 

The section Notes/Cements is to be used by the supervisor to note re- 
marks relating to the need for corrective acticn or additional information 
to meet the casework requirements. 

Special I'fote /* . 

Supei.-viscrs are not to sign the form unless the IWH* meets all case^rk 
r&mxi^its. If cor5ia:icns or additions are necessary the supervisor. 
sSuld note this and return to the counselor, unsigned. . 
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Casework Reouirarents B 



/— Individualized Written Ffehabilitaticn Program Status 10 - 



12, 1 - 3, 5 - 9 



^ f Extended Evaluation 



IWRP 



Status 02 - 06, }■ " ^ 



A olan rationale whidi indicates; 

a. / 7 Hiat pertinent prcblearts and questicns 

have been thoroughly chedced out and 
appropriate serivce needs identified. 

b. / 7 Sufficient exploration in ciiocsing a 

vocational dixection, throu<^ the 
orocass of assessment and evaluation. 

N/A LJ \ 
■ \ 

c. / / That contingencies are anticipated 

before plan is forroiLated so that 
provisicn can be made. 

d. / 7 The ultinate goal of the plan and hew 

this is to be acccnplished. 

2, / 7 The plan raticnale considers physical , 

psychological, social^ vocaticnal ^ 
educatimal and oth€:r factors vMch 
bear on or are. pertinent to the 
applicants /clients rdiabilitaticn 

process, 

3, / 7 Clear and concise Ta'RP document in the 

case consisting of client ide ntifi - 
cation,, vocational goal, N/A / 7 # 
. w.' a fully developed listing of all the 
intenrediate objectives, dates of 
beginning to corpleticn and the cost 
to the Divisicji as well as through 
other resources being applied. 

4, / 7 The extended evaluaticn plan raticnale 

specifically related to; the addition- 
al information needed to decide on 
rer^bilitaticn potential and assess 
the possibility of overcoming problems 
and barriers related to enployability. 



5. / / Ident ifie d as severely disab led . 

Yes /_/ No / . / 

6. / 7 Special Selection Criteria Worksheet 

conple ted , signed and in the record • 
N/A / / 

7. / 7 Copy of clients ri^^ts and respon- 

sibilities signed by the client or 
parent/guardian, in the record. 

8. / 7' Copy of the IWRP, signed by cli^t 

or parent/guardian in the record. 

9. / 7 ; IWEP is maintained as a s^^arate 

jpart of the case record. 



NOISS/ga'iMENrS (by number) 



Cdunselor_ 
Super^dsor^ 

ERiC 



Date 



Date 
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VSiai iioviBg srty casa into-atatia 20, this fara will ba ccn?)lated in its _ 
entirety and attad-jad to tha proccESS 3heet en which tha status ciianga narrative 
is typad. ' . 

Explanaticn tha raquirsmnts with net appUcable (N/A £17) dsaignaticn. 

S2. ;?pUe3 <=ily to' these casjea in whidi tha. plannsd servioa ara Icng-r 
than cna year in duratica. 

Tha aectioi "^totas/Ccmnaits" is to used by tha sispervisor to n ota _ 
ranarks relating to th3 naed for corx^ctivQ acticn or additional iaxcEMticn 
to nziat tha czsewcrh requixEsrants. ' 

Sca<:3.,Tl Nota 

Scsarviscrs ara not to "sicn tha form unlosa tha record iraets all C3ss:*^ 
roquirticnts. If ccr5S5dcn3 ^ edditicna ara necessary, tha suKsrvisor sftouid 
roto this snd r2t:im to tha coirrsalcr, unsignad. 
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Status Ciange 



14, 15, 18, - 20 LJ 



1-6 



1. Msvainnt to status 20 =i:st: incluis.: 

a, / 7 A narrative evaliisticn uhidi rx?- 
"^"^ prasems the basis for tha stistus 

chanca and affiles in rraasiarable 
tarns tha clients readiness to 
acxxTOiish stzx:c^ 20 's rws? cbjectivT2£ 

b. /^^ TSva narrative evaluaticn dssrcastrctes 

hr^ t±:a client's TinHP and xrjcaticaal 
goals are still ccnsistint and 
s\:p?ort£d by infbrraticn d^ttuned 
to data. • 

c^ / 7 naxr a Li-'/e rscord and E-TFP^ 

su??l£2n3nt indicitcs. what actions 
the* c^ixsalcr plans with tha clicait 
to acccnplish pLaoatent. 

2. / 7 teview of the total IKF? (its outcana 

and planned acrcicns and cbjectives 
was ccnducted at le^st amvisJLly.) 
. N/A £17 

3. / 7 Actions planned and s<ri£ciiLed in tha 

TaT? ai:d possible Kz:2rjti2Si^zs were 
cicoc:roli2hsd or, if ncc, are 
e:<?lained* 

4. /TZ/* Centner has been mintain^d with tha 

cii-^t (at least, cnca e^-^ery 2 rofiths) , 
and the cixcora of tha ccnczicts axe 
reflected in timly and concise 
cnse msccrding, if not, th:;iir absen?:e 
is e^lain22d. 

5. /~T Acfditicns and arencrr*2nt3 to the CvTP 
are correctly reflected in th^j caise. 



5. / 



CDtr:s€lor 



Cate 



11:3 Review and Evzduaticn of 
Progress secticn of the WFP 
i3 utilized to record oorpleticn 
of the various objectives. 



MJl S S /gl^g'gyiS (bv niJber), 



^ 'SupiTvisor 
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f.'hen closing a case in status 30, 28, or 26, this form will be ccnpleted and attached' 
to the closure surmary. \ . , - 

Depending upon tte type of closure, ^tiiis form should be corpletad as indicated belw. 

.10 - 30 1 . . . ' 1 - 11 , . 

12-30 ' 1-11 

14, 16, 18, 22, 24 - 28 .1 -32 

22-26 9-21 

Explanation of requireirents with not applicable (N/A / /) designation. 

5^2. teeting and review with the client, parent or guardian for full discussidi 
prior to the closure action, accept when: 

a. Itiere is evidence in the record to substantiate counselors efforts to arrange 
appointments (at least two letters) issuing or confirming appointments, 
which are not kept and there is no response. 

b. The client, by am written stateinent or by that of a legal representative, refuses- 
the discussion. 

c. The client or representative requests the closure, in writing or verbally. 

d. There are intervening reasons whic±i would make such a meeting iirpractical or 
iirpossible; 1. died; 2. noved out-of-state; 3. unable to contact; 4. in- 
stitutionalized and unavailable; 5. other ' reasons similar to the aLforementicned. 

\ e. In every instance vdiere intervening reasons other than death prevent a ireeting 

and discussion with the client or representative, a letter will be sent informing 
of the right to re-ccnsideraticn/appeal if it is so 'desired. (Also, a copy 
to referral source or other appropriate individuals)": At least 3 wee3cs advance 
notice should be given. 

#5. Ifeferrals may be made to mental health agencies, V.R. in other states etc. , 
however, the referral should be discussed, with the client in advance. 

#6. In cases \^ere more e:^:erience and/or new 'information^ leads to a finding of / 
handicap too se^^^^^gwith no reasonable ei<pectaticn of enployability, a certification j 
of ineligibilities' annual review requirements are observe. " ; < . ^ 




• #8. Applies c2^^ to cases closed. in stattis 28. \^ 

#11. Applies only to clients receiving SSDI/SSI benefits, at time of closure. \ 

• • ^^^^^ 
#20. Applies cnly to chose cases in the SSQI/SSI caseload. ^ 

The secticn"Notes/ConTTents" is to be used by the supervisor to note remarks relating to. 
thje need for corrective action or additioial information to meet the casework regu* rements , 

Special Note 

Supervisors are not to sign the form unless the record meets all casework requirements. 
If corrections or additicns are necessary the supervisor should note this and return 
to the counselor, unsigned. 
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Casev;or]; Recaiirenients D 



Closure 10,, U, - 30 /~7 1 - 11 14, 16, 18, 20, 22, 24 - 2^^ /_/ 1- 12 22 - 26 /~7 9 



1. / / The R-300 is ccnplete and the closure 

reason is coc3ed. Status 28 or 30. • 

2. / / Prior to closure action, the basis v;as 

discussed with th e cl ient, parent or 
^guardian. N/A / / 

3. / / Letter sent to client informing of the 

determination to close and rights of 
reccnsioeraticn/af^cil . 



4. / / liStter sent to referral source indicating 

reasons for closiire and closure action. 

5. / / Referral is made to other agencies as 

appropriate , contacting the receiving 
agency and forwardin g of necessary 
information. N/A / / 



6. / / Certificate of inel igib ility is coipleted 

and signed. N/A / / 

7. / / Closure narrative, status 28 & 30. To 

include; brief synopsis of services 
provided, the outccne and reasons for 
closure. 

8 V / VR services for accoriplishing the IWRP's 
objectives' were provided as planned and 
scheduled, up to the closure, a nd i f 
not, reasons are given. N/A / / 

9. / / The ccnclusicn of any outstanding business^ 
... cancellaticn of unused authorizations, 
all bills processed and paid. 

10- / / Contact has been maintained with the 
client (at least once every 2 months) , 
and the outcoiE of the contacts are 
reflected in timely and concise case 
recordings, if not, their absaice 
is explained. 

11. / 7 853 document conpleted. N/A / 7 

12. / / Additions and amendments to the IWRP are 

correctly reflected in the case. 

13. / 7 The R-300 is ccnpleted and the closure 

reason is coded. Status 26. 



Counselor 



Date 



Supervisor 



Date 
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14./ / The ^view and Evaluation of Progre, 

sectijCn of the IVTRP is utilized to 
redord conpletion of the various 
objectives. 



15. / / Planned actions were carried out as 

scheduled,, or, if not, are exolaine 

I 

16. / / The services provided in the IVJRP 

are' clearly contributory in a 
substantial way to the enployment. 

17. / / Substantial placement. servicS^ by — 

counselor were provided, or, if not 
there is an indication of hew 
placement was acccrrplished. 

18. / / -There is a clear relationship 

between the services and vocational 
outocHTie . 

19. / / The enployment is determined to 

. - be satisfactory and has been main- 
tained for a period of not less 
than 60 days. 

20. / / The level of eirployment is ooma>- 

ensur ate w ith the SGA level. 
N/A / / 

21. / / A conplete closure surm^ary which 

incliides; a siimory of services 
provided and the results, the 
enployment situation including, 
erployer, place, salary, type of 
• job and a . clear indicaticai post- 
CTployment services were e>plained 
and planned where appropriate • 



NO^ES/O0^M3^TS• (by number) 
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Ms. Susan Stoddard 
May 1, 1981 

each month. One copy is also retained in Central Headquarters 
for use as needed by the Quality Control staff or administrative 
personnel. The two left handed circled columns report the client's 
current status and the date the client , entered that status. The 
set of columns on the right reports the number of months the client 
has been in each status from the date of referral to the date of 
the report. " . 

These flowsheets are used by counselor and supervisor to plan and 
monitor caseload management, including rate of service delivery. 

When there is question for a specif ic ; aspect of caseflow, the 

I 

Director of Vocational Rehabilitation i reviews the flowsheets or 

\ . ■ i 

has the Quality Contsrol staff perform; any needed svmimary of data. 

2. Statistical Tables I, II, III (exhibit'' #2) - These tables summarize 

the status of each counselor's caseload. They are distributed 
♦ / 

/ 

to all counselors, supervisors, and Quality Control staff. Among 

the items of information are the monthly referral backlog SLXxdj^ — ^ 

/ 

monthly applicant backlog. This /index is the number of cases on 
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hand divided by the monthly average of cases processed, year~to-date 

■/ ■ . 

A high ratio is viewed as a "flag" by counselor, supervisor, and 

/ ■ - ■. 

administrative staff. .As a "flag", it may be used by staff to 

/ ' > 

examine the flowsheets. This) examiniation will determine if the 

high ratio is a function of an undue length of time in referral or 

applicant status for the caseload as a whole, or is a function of 

a high number of new referrals or applicants. 

Report of 'Unusually Inactive Clients - The Vocational Rehabilitatio' 
Accountant annually compiles a list of open clients for whom there 
has been no financial expenditure for a two year period. This list 
of clients is forwarded to the individual case supervisor for 
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May 1, 1981 



Ms. Susan Stoddard 
Project Director 

Berkeley Planning Associates . * 

3200 Adeline Street 
Berkeley, California .94703 

Dear Ms. Stoddard: 

Mr. Coppage has asked that I answer your request for information 
regarding the Agency's monitoring and control of the rate of^service 
delivery to clients. 

The primary responsibility for monitoring and control o^ the rate 
of service delivery lies with the counselors and the case Supervisor . We 
do not believe it necessary to have an elaborate system specifically for 
identifying undue delay in service delivery. The reasons for this are 
twofold: First, comparison of our Agency's performance with that of others* 
indicates that our ^performance in this. area. is very satisfactory. Second, 
reports available about caseload, flow are widely disseminated among super- 
visors, counselors, administrative staff, and Quality Control unit. Hence, 
specific problems are likely to very quickly emerge without formal communi- 
cation. The three reports containing information about rate of service 
delivery we use are: 

1. Counselor Flowsheets (exhibit #1) - Copies of these are sent to 



the' VR counselor. 



the VR field, secretary, and the case supervisor 
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BVR CASE RECORDING STANDARDS 



Why have case recording standards? / 

There are two (2) basic reasons why the BVR is. adopting case'^recording standards: 

1. To promote good case planning and casework practices^/ 

2. To comply v)ith federal recording requirements. 



:7 



The elements of BVR case recording which are being standardized are: 

I. Contact Reports / 
II. IWRP Closure Narrative // , 

III. Other / 

These three (3) elements of case recording to .be standardized are discussed in 
more detail" in the remainder of this paper.; ( 

****'*** 

I. Contact Reports / 

There will be six (6) instances ir^ which narraj^v^e^CDivtact'T^eports by the VR 
counselor will be required. These arei — ^"^"CC 

A. Initial interview . 

B. When referral /appl icant is determined to be eligible, ineligible, or is 
placed in extended evaluation (status 06) 

C. When the initial-IWRP is written (status 12) 

D. Every six (5) months while case is in active status (statuses 10-24) 

E. When client enters employment (status 22) 

F. When client enters post- employment (status 32) 

/ Required content "for the abovetrl isted six (6) type of contact reports is as 
fol lows: • - 

A. Initial Interview . , 

This contact report reflects the VR counselor's first interview with the 
referral. It must contain; ata^minimum, the following information: 

L How the referral came to VR, including a brief summary of the referral 
information ■.- 
^-2'. A statement that VR services were explained to the refe.^ral /appl icant 

3. A statement that the referred individual has been informed of his/her 
civil rights, right to confidentiality of personal information, and 
the right to administrative review and fair hearing 

4. Referral 's apparent or self -reported level of independent functioning 

5. Referral 's apparent or self -reported limitations imposed fay the visual 
disability . 

March, 1981 
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Ms. Susan Stoddard 
May 1, 1981 



followup with the counselor. 
We have not felt the need to set explicit maximuni standards for *'time 
in status''. We do not wish tc emphasize the rate of service delivery at 
the expense of the quality of service delivery; However, we have recently 
adopted overall caseload recording standards (exhibit #3). These are - 
intended to assist counselor and supervisor in managing their caseload. 
Implicit in these standards is that contact with the active client occurs 
at a minimum once every six-^months . We may shortly be developing plans 
to monitor the effectiveness and compliance with these standards. 

I hope the enclosed information and attachments will be of help to 
yo-u. Please contact me if you wish further information. 



'1vTC/MA:hcm 

cc: Thomas C. Michael 
William T. Coppage 

Attachments 



Sj-ncerely , 




Rehabilitation Special is t 
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for the status 10 and status 12 contact reports; or he/she rndy 4^ %,o 
or three separate contact reports dated the same day, each moving the 
case through one status (Example: A client's case is being accepted 
and moved to status 16 on February 15. Technically' the case moves 
from 02 to 10 to 12 to 16 on February 15. The counselor m^y do one 
contact report addressing the required elements for accepting a case 
and also addressing the required status 12 & 16 contact report litems. If 
the counselor does one contact report, the "status this report" box 
on the contact report form should read "10-12-16". The alternative 
approach is to do b contact report moving 'the case from 02 to 10, 
another contact report moving the case from 10 to 12, and a, third 
contact report moving the case from 12 to 16. ; 

Every .six (6) months while case is in active status (statuses 10-24) 

Progress/contact reports will be required periodically (every six months 
seems reasonable) while client is in active status. The purpose of these 
reports is to document progress made in the case, significant develop- 
ments or problems encountered. ' 

The six month requirement- for cases in active VR status should be viewed 
ar a minimum requirement. Special circumstances sometimes arise inwhich 
r, ; counselor should not wait until six months later to do a contact re- 

t. This is an area in which the counselor must rely on his/her own 
best judgment. Examples of situations in which the counselor may wish 
to do a contact report without waiting up to six months would include: 

change of vocational goal 

change of rehabilitation status number 

illness which interrupts client's rehabilitation 

program 
etc. 

The SOAP model is recommended for structuring these contact reports. An 
explanation of the SOAP model is as follows: 

S = SUBJECT (client's name, date.-status , why the contact took place) 

0 =bJECTIVE (what developments led up to this contact, what has been 
going on in the case since the last report, what happened 
during the contact/interview) 

A = APPRAISAL (the 'VR counselor 's interpretation of the facts covered in 
"0" above, the VR counselor's opinion as to the meaninc 
of the Hev jlopments reported in "0" above) 

P - PLANS (what plans and/or action steps will the client and/or 
counselor make/do now) | 

When the client enters employment (status 22) 



This contact report must contain: 

1. The job title and a brief , description of the job the client is 
er]|fering 

2. Explain how the job was located/acquired 

March, 1981 
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6. ReferraTs family situation 

7. VR counselor's observations as to apparent rehabilitation potential 

8. What additional diagnostic studies/reports are needed to establish 
eligibility, and what is being done to obtain these studies/reports 

When referral /applicant is determined to be eligible, in eligible, or is 
placed in extended evaluation (status 06T 

ELIGIBLE 

1. Sunmary of findings from the diagnostic studies; must address the 
following areas: 



Relate these findings to items 2-5 below. 

2. Explain why the disabling .condition(s) of the client is(are) handi- 
capping to employment 

3. Explain why the client has the potential to eventually obtain employ- 
ment 

4. Explain how VR services will assist the client to become employable 

5. Mention any plans for further diagnostic or evaluative studies 
INELIGIBLE 

6 When a case is being closed in status 08 (not eligible; for VR services), 
explain how the individual does not meet at least one of the following 
conditions: 

a. presence of a visual disability which causes a handicap to smploy- 



b. presence of a reasonable expectation that VR services will improve 
the individual s's employabi lity 



7. When a case is being placed in extended evaluation to determine rehabil- 
itation potential (status 06) the following requirements must be docu- 
mented in the contact report: 

a. presence of visual disability, or a combination of visual and other 
disabilities, which im_pose(s) a handicap to employment. 

b. Uncertainty as to whether VR services can improve the individual's 
employabil ity. Be specific as to areas of uncertainty, such as 
health, stamina, skills, level of intellectual functioning, etc. . 

When the initial IWRP is written 

State the vocatio/ial goal and explain how planned VR services will lead to 
attainment of the goal. Also explain why this .particular vocational goal 
has been developeid for/with this particular cl i~ent^ 

When a case is being accepted and moved through several statuses in- one day, 
the counselor may do one contact report which addresses all required items 



medical 
vocational 
educational 
social 



ment, 



STATUS 06 
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This narrative must explain why the client no longer is expected to 
benefit from VR services. Occasionally a case will be -id for VR 

services and movto -'ntc status 10, then closed in status 30 before an 
IWRP is written. In such cases (closure in status 3(. r.orn ? .uui iU , 
a closing contact report must be done since there is no IvIRi'. 

D. Closure from Post-Employment 

Surmarize what occurred during the time that the case was in post-employ- 
ment services, what VR services were rendered, and the outcome of post-^ 
employment services. (Is client still employed? At what job?) Identi.y 
the post-employment closure status (status 33-39) in which the case is 
being closed. 



III. Other 



A. VR counselors are to continue to distribute to VR referrals/applicants, 
during the initial interview, the half-page civil rights statement (RD-37). 
This form is being updated to include additional rights for the handicapped 
which have come into existence in recent years. 

B. VR counselors are to continue using the form letter (RD-5) to notify clients 
of closure in status 08. 

C The 1978 version of the Rehabilitation Act appears to state that the VR 
client has the right to see all the contents of his/her case folder. We 
are waiting for issuance of the final implementing regulations to include 
this requirement in our own policy. VR staff should be' aware of the proba- 
bility of VR clients in future having the right to. see their entire case 
folder. This will mean that VR staff must be objective in their reporting 
of client behaviors. Any assessment or opinion of VR staff which appears 
in the case folder will have to be supported by "objective" facts. The 
counselor's observations of a client's behavior is "objective'' if the 
counselor describes client behaviors and avoids making value judgments 
(do not say, "Client is lazy and unmotivated to work"; say "Client has _ 
failed~to keep two employment interviews, and has turned down a job ofrer^^ 
for a job which is compatible with his/her aptitudes and stated interests .) 



March, 1981 



ERIC . ^ 



rayc ruui 



3. Explain why the job seems suitable for the client 

:/:>lain any problems which the client may be having on the job 
(.-')i;ity to do th... lob tasks, other workers, transportation, 

fltc.'l; and what is being do-it to resolve any problems 

5. fention any outstanding bills 

6. If the job obtained constitutes a major change v*i tne cl ient's 
vocational goal, explain how/why 

F. Vlhen the case enters Post-Employment Status (status 32) 

This contact report is to contain: 

1. A sta . :;l2m(s) 

2. An expia., /.ior, wi ncv' additional VR services will solve the 
problem(s) 



Please note that a narrative contact report is nbjt required when closing 
a case which has an IWRP (status 06-08, 26, 28, most 30's and 33-39). 
The narrative on the closure section of the IWRP form will suffice in 
those instances. 

II. IWRP 

A narrative must be done on the closure section of the IWRP form for those 
cases which have IWRPs (status 06-08,. 26, 28, some 30's and 33-39). The re- 
quired information for these reports follows: 

A. Status 06 to 08 closure 

Discuss the findings obtained from the diagnostic/evaluative studies; and 
use this information to show that the client cannot reasonably be expected 
to improve in employabil ity as a result of VR services. 

B. Status 26 closure 

1. The basis on which the case is being closed as rehabilitated (client 
is employed or is functioning as a homemaker), weekly gross earnings 
at closure, whether the job is full-time or part-time. 

2. ' "^'^ ^f how the client has made a satisfactory adjustment to 

tllU juu. - 

3. A statement that the client and employer are both satisfied. 

4. A listing of VR services which were rendered; and how these services 
helped the client obtain and maintain employment. 

5. A statement of whether post-employment services are planned. 

6. A statement that the client has been informed that his/her case is 
being closed. 

C. Status 28 and 30 closure 

■ . March, 1981 
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Susan Stoddard 
April 27, 1981 
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If you un\rc r.ay que.^tioniJ feel free to contact me at (206) 753-078A. 



S i ^jcerely , 

Carl H. Rennewitz, Progr'^ttbManager 
Office of Management Servic^^s 
Dxvxsion of Vc .... tiv,»u. Rehabilir 'i r Ion 
0B-21C 



CHR:jaw ^ 

c: Bill Griffith 
Les James 
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Al AN I CIBIJS 
S(»rft'!ary 



STATE OF WASHINGTON 

DEPARTMENT OF SOCIAL AND HEALTH SER VICES 

Olympic}, Wjshington VBSO-i 
April 27, 1981 



Susan Stoddard, Project Director 

BerV ley PJr.'inin, '\ssociates 

Berkeley, Calx'-^Vr 9A703 
Dc^ar Ms. Stoddard: 

Two i >:'t]v ' oyec !ressing the potential problem of a client wlicse 

rehabilitation process hab -n d. 

The first is the organization-function procecis. The counselor is responsible 
to maintain the agency relationship for planning and negotiation with each 
client, and to follow along with the client. The supervisor of the counselor 
has the responsibility of case* review, documenting the review, analyzing any 
problems, and suggesting solutions to the counselor. Delays in case movement 
can be detected from narrative case recording entries, the basis of case 
documentation by the counselor. 

Internal review teams compoF'^d of administrators, supervisors, and counselors 
from an organization unit other than that of a caseload counselor periodically 
review a sample of each caseload to look for compliance to established policy 
and procedure. Reports are assembled based on aggregated findings, not 
individual client records. 

The second method employs the job functions discussed in the first method 
prompted by our Integrated Client System (ICS) reporting mechanism. Standard- 
times-in-s tatus have been established for the non-plan VR statuses. The plan 
Status time standard used. is the projected ending date of the plan. Each 
month ICS prepares a listing of clients for whom the ^counselor is responsible 
which provides time in VR status and flags those clients who have been in 
current status greater than the standard time for the status. 

The supervisor receives an exception listing of those "over-standard" clients. 
The exception listing also gives those clients whose plans have expired, those 
closed clients to be contacter? for an annual review, and other client "out-of 
policy" conditions which can be detected from client data base elements. 

Each counselor, supervisor, and administrator receive monthly a summary report 
which shows a snapshot of each client population including the out-of-standard- . 
time variable. 
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THE STATE ' -^idr^^ 



OF WYOMING 



Administrative Offices 
Hathaway Builc^mg 
Cheyenne. Wyoming 82002 
Phone & TTY; (307) 777.7385 



DEPARTMENT OF HEALTU & SOCIAL SERyiCES 

DIVISION OF VOCATIONAL REHABILITATION 



April 29, 1981 



Reply to: 



Susan Stoddard 

Project Director 

Berkeley Planning • Associates 

3200 Adeline Street ' 

Berkeley, 'California 94703 

Dear Ms. Stoddard: 

Our "flagging" procedures are very simple. The Supervisors 
review any status 02's. after longer than three months; status 
06 's approximately every six months; and any other status ' ^ 
that would seem to be unusually long term. Enclosed you will 
fin- th^-^ statistical documents that bring this to our attention. 

Because we review every case at least annually, we are interested 
in programmatic evaluation and rarely use status f.alone, except 
to help pinpoint counselor case management probLfetPS. 

Quality assurance is accomplished through Program Evalu'ation 
(copy enclosed) and Supervisor review. Enclosed you v;ill also 
find a general outline 'that we use. This is then ind.ividualized 
according to each counselor's particular needs and goas mto^ 
much more elaborate detail. Enclosed are two typical Supervisor s 
reviews. 

I hope this is of some help. 
Aye, 



Bernard W- Giese 

Field Services Director 
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EARL VV. WOLFE 
Director 



STATE BOARD DF V O C A T I O N A L E D U C A T lO N 

DI\/iS10N OF VOCATIONAL REHABILITATION 

Stato Capitol Building Churiestoj, West Virginia 2S305 

April 15, 1981 



\ <304l 348-2375 



Ms. Susan Stoddard, Project Director 
Berkeley Planning Associates 
3200 Adeline Street 
Berkeley, California 94703 

Dear Ms. Stoddard: / 

In your letter of April 6, 198]/, you asked for copies of any materials 
Khich we use h\ our agency for: . 

•Case flagging (procedures, manual chapters, review techniques, etc. 
to identify undue delays in statuses); 

•Quality assurance (monitoringj control, standards, efc). 

I am sure that you already have the materials issued by the Rehabilitation 
Services Administration. We use those materials extensively in our work. IVe 
do not have any additional materials ivhich would appear to be in line with your 
request. * . . 

Sincerely yours. 

Earl W. Wolfe, Director . 
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